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Abstract 

The capacity region of the A'-user Gaussian interference channel (GIC) is a long-standing open problem and 
even capacity outer bounds are little known in general. A significant progress on degrees-of-freedom (DoF) analysis, 
a first-order capacity approximation, for the A'-user GIC has provided new important insights into the problem of 
interest in the high signal-to-noise ratio (SNR) limit. However, such capacity approximation has been observed to 
have some limitations in predicting the capacity at finite SNR. In this work, we develop a new upper-bounding 
technique that utilizes a new type of genie signal and applies time sharing to genie signals at K receivers. Based 
on this technique, we derive new upper bounds on the sum capacity of the three-user GIC with constant, complex 
channel coefficients and then generalize to the A'-user case to better understand sum-rate behavior at finite SNR. 
We also provide closed-form expressions of our upper bounds on the capacity of the A'-user symmetric GIC easily 
computable for any K. From the perspectives of our results, some sum-rate behavior at finite SNR is in line with 
the insights given by the known DoF results, while some others are not. In particular, the well-known A'/2 DoF 
achievable for almost all constant real channel coefficients turns out to be not embodied as a substantial performance 
gain over a certain range of the cross-channel coefficient in the A'-user symmetric real case especially for large 
K. We further investigate the impact of phase offset between the direct-channel coefficient and the cross-channel 
coefficients on the sum-rate upper bound for the three-user complex GIC. As a consequence, we aim to provide 
new findings that could not be predicted by the prior works on DoF of GICs. 


I. INTRODUCTION 

As the recent emerging wireless networks with a tremendous amount of mutually-interfering links tend 
to be severely interference-limited, interference management plays a more central role to improve system 
performance. The classical way to treat interference orthogonalizes the channel access in time, frequency, 
or even code domain. However, this approach has been known to be suboptimal in general. The interference 
channel has been one of the long-standing fundamental problems in network information theory since [lj, 
which finds an optimal way of managing interference and investigates the fundamental performance limit of 
all interference management schemes, i.e., the capacity region of this channel. However, the sum capacity 
of even the simplest 2-user Gaussian interference channel (GIC) has not been fully understood, 

although it was recently shown in p] that a relatively small gap between the new upper bounds therein 
and the time division (or frequency division) lower bound is left in the weak interference regime. The 


well-known outer bounds on the capacity region of the two-user GIC are the Kramer bound (101 and the 


Etkin-Tse-Wang (ETW) bound [2j. The capacity region of the A'-user GIC with K > 3 is unknown in 
general, except for the sum capacity in some special cases including the very strong interference regime 
[lllj for the symmetric 1 GIC and the A'-user extension of the noisy (very weak) interference regime [3|, 
[4]. The notion of strong interference in the two-user case does not naturally extend to even the symmetric 
three-user case GD- For the cyclic A'-user GIC (Z-interference channel), its capacity region to within a 
constant gap is studied in [ 121 based on the well-known (HK) scheme and the ETW bounding approach. 

It is in general quite difficult to obtain either a constructive lower bound or upper bound on the sum 
capacity to better understand the more than two-user case. For instance, the HK scheme becomes extremely 
complicated for K > 3 even with Gaussian signals and without time sharing. To the best of the author’s 
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knowledge, only a few useful upper bounds that help understanding the capacity are known (e.g., 0, [ F3J, 
[14]). Hence, most of the related works have focused on a simplification of the problem of interest for the 
K -user GIC and restricted our attention to the DoF capacity approximation. For the DoF characterization, 
the significant progress has been made mainly owing to interference alignment [15], deterministic 
channel model [17], and structured codes [ |T8| , [ T9j[ . The notion of interference alignment is decoding the 
sum of interfering signals rather than decoding a part of the individual interference in the HK scheme. 


A. Prior Works 

There are several generalizations of the above two-user upper bounds to more than two-user cases. In 
[|3J, the ETW bound was extended to the A'-user GIC by using a vector genie. However, the resulting 
useful genie bound is not so tight in general. As a consequence, for the three-user symmetric case, the 
genie-aided upper bound was further tightened by allowing correlation between all additive noise variables 
and shown to be optimal in the noisy interference case. The Kramer bound was generalized to the three- 
user GIC in p~3| by using the linear minimum mean-squared error (LMMSE) estimation based proof [TO] 
and by following the Sato approach [20] that exploits the fact that the capacity of GIC depends only on 
the marginal noise distributions so that correlation among Gaussian noises does not affect the capacity. 
This bounding technique was further extended to more than three-user cases and some capacity results 


of certain classes of A'-user GICs were given in [14]. A multiple access upper bound was presented in 


[211 for the sum capacity of the three-user symmetric GIC, where receivers are provided with sufficient 


side information so as to decode a subset of the users in the corresponding multiple access channel. This 
approach was extended to the A'-user case in |22j but the resulting upper bound has not been evaluated 
in the literature. Therefore, there have been only few known upper bounds on the capacity for more than 
three-user GICs. A common framework in the existing bounds for more than two-user cases is based on 
imposing mutual correlation between noise variables to tighten their bounds. Within this framework, a 
major difficulty of such bounds is that they involve the numerical optimization of a covariance matrix 
of jointly Gaussian noise variables, which makes it hard to generalize to the large A' case. Even if the 
generalization is available, it is infeasible to even compute the resulting upper bounds unless A' is small. 

For the fully connected GIC with more than two users, the interference channels that the existing 
DoF-based capacity approximation results have considered can be categorized as the following two types: 
time varying/frequency selective channels and constant (static) channels. Initially, Cadambe and Jafar 


[16] showed that vector-space interference alignment can achieve K/2 DoF for time varying/frequency 


selective channels. The ergodic interference alignment [23] allows each user to achieve 1/2 its interference 


free ergodic capacity at any SNR, but incurring very long delay due to its opportunistic matching of 
complementary states. Assuming that channel coefficients in each channel use is drawn independently 
from a continuous random distribution, this type of channels requires sufficiently fast-variation/high- 
selectivity, which may not be common in practical systems. Hence, we rather focus on the constant GIC 


in this work. For constant channels, the K/2 DoF was shown by Motahari el al. [24] to be achievable for 
almost all channel realizations through the use of Diophantine approximation. More recently, Wu et al. 


[25] recovered the same result by developing a general formula based on Renyi information dimension. 
In the complex-valued GIC, phase alignment with asymmetric complex signaling |26j can be exploited 
to achieve at least 1.2 DoF for almost all channel coefficients in the three-user case. In multiple-antenna 


GIC, vector-space alignment is known in [ 271 to be feasible for A'-user symmetric square MIMO GIC 
if and only if the number of antennas is larger than or equal to rf( A +1 ) , where d is the number of DoF 
per user. Meanwhile, the condition of almost all channel coefficients in [24[ precludes only a subset of 
Febesgue measure zero in reals, M. However, the exceptional cases of measure zero include the set of 
rational numbers, dense and infinitely many in M. In particular, Etkin and Ordentlich [ 281 showed that the 
DoF of GIC with all rational coefficients is strictly less than K/2, thereby concluding that the DoF of GIC 
with K > 3 is everywhere discontinuous with respect to channel coefficients. Moreover, any irrational 
number can be approximated by a rational number arbitrarily close to it. This implies that very next to 
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every good channel is bad channel [29]. Consequently, the practical implication of the above remarkable 
DoF results might be limited to some extent. 

The above discontinuity phenomenon has also been observed in other DoF results that do not exploit the 
irrationality of channel coefficients. Jafar and Vishwanath [ f30| showed that the well-known generalized 
DoF characterization in |2j for the symmetric two-user GIC naturally extends to the symmetric (positive) 
real A'-user GIC, with the exception of a singularity when SNR and interference-to-noise ratio (INR) are 
the same, i.e., the common cross-channel coefficient is 1, where DoF is only 1. It was also shown by 
[261 that the three-user complex GIC has at least 1.2 DoF for almost all channel coefficients, while just 1 
DoF for a measure-zero subset of channel coefficients satisfying certain phase and amplitude conditions. 
Furthermore, the symmetric GIC has 1.5 DoF if all direct-channel coefficients are 1 and all cross-channel 
coefficients are v / '~C which is an exceptional case where the exact capacity of Ay21og(l + 2SNR) is 
known [ 161. More recently, it was reported that the discontinuity of DoF characterization with respect to 
the channel coefficients might be in fact due to the asymptotic analysis in the high SNR limit and that it 
may not appear any longer at finite SNR. For example, see [29[ for the two-user Gaussian X channel and 


[311 for the A'-user symmetric GIC. They provided constant-gap capacity approximations to circumvent 
the limitation of DoF characterization and to better understand the capacity of X channel and GIC at finite 
SNR. However, even if the constant gap results hold at any SNR except for an outage set of channel 
coefficients whose measure vanishes exponentially with a target gap c > 0 increasing, their constant gaps 
seem to be large to date. In [31], their scheme approximates the sum capacity of the A'-user symmetric 
GIC to within a constant gap of c + log(A') + 10 bits up to an outage set of channel coefficients of 
Lebesgue measure smaller than 2 -c , implying that the constant-gap capacity approximation may be weak 
to appropriately capture the sum-rate behavior at finite SNR. Therefore, understanding the capacity of the 
A'-user GIC at finite SNR still remains far from the two-user case. In particular, we have an intriguing 
open problem as to how much the important asymptotic result on the achievability of AT/2 DoF for almost 
all constant channel realizations can be embodied as realistic performance gains outside of the high SNR 
limit. 

In this work, we would like to draw attention to careful interpretation of the DoF results by pointing 
out that DoF is not necessarily translated into a substantial sum-rate performance gain for practical values 
(e.g., 10 to 20 dB) of SNR This is the case with multiple-antenna communications such as multiple-input 
multiple-output (MIMO) point-to-point/broadcast/multiple-access channels when the multiple-antenna 
channels are highly correlated (e.g., [32]), where DoF is not fully attainable outside very high SNR. 
Bearing this in mind, we would l ik e to derive useful upper bounds on the capacity of complex-valued 
GIC with more than two users for SNR of practical interest. 


B. Contributions 


We first develop new upper bounds on the sum capacity of the three-user complex GIC, inspired by 
the Etkin-type upper bounding approach Q and the change-of-interference approach |8j. The latter is 
a new genie-aided approach where the noisy interference signals instead of the noisy input signals are 
provided to the receivers and used to replace those arbitrary interference signals with independent and 
identically distributed (i.i.d.) Gaussian signals. The known genie-aided bounds were shown to be tight 
in the noisy interference regime. New ideas in deriving our bounds in this work are the use of genie 
signals in a different way and a combination of the two bounding approaches in conjunction with time 
sharing on the genie signals at the receivers. The resulting upper bounds are shown to be tighter than the 
existing bounds over a certain range of channel coefficients. The three-user upper bounds are particularly 
designed to be amenable to the extension to the general A'-user case. In particular, we do not involve 
any auxiliary random vector (e.g., vector genie) or optimization of a noise covariance matrix in contrast 
to the aforementioned framework used in Q, [JT3j, [21], [2~2|. Even if the resulting A'-user upper bounds 
have a relatively low computational complexity, the complexity still becomes prohibitively large even in 
the symmetric case for A' large. To overcome this difficulty, we further provide closed-form expressions 
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of our upper bounds for the A'-user GIC that is a continuous function for large K, whose domain is 
M, whereby we can investigate the sum-rate behavior for any K and any real-valued channel coefficient 
irrespectively of whether channel coefficients are irrational or rational. To this end, a key step is to identify 
and exploit an intrinsic structure in our upper bounds, which lends themselves to canceling out some pairs 
of differential entropies. This is because our bounds intentionally avoid the use of auxiliary random vectors 
and the optimization of a noise covariance matrix. The analytical upper bounds have no discontinuous 
point in the large AT symmetric real case. This points out that the exact capacity behavior may not show 
a large fluctuation due to the irrationality of channel coefficients for any AT in this symmetric real case. 
To be fair, the same observation can be found for the three-user case, e.g., in [ 131. Another benefit of 
the proposed analytical bounds is that they are amenable to an affine approximation in the large A' and 
high SNR regime, inspired by |j33j. We show that as A' grows, the performance benefit promised by the 
well-known AT/2 DoF results may not be realized even at high SNR over a certain range (around g 2 = 1) 
of channel coefficients for the A'-user symmetric positive real case. 

The second part of this work is devoted to the study of our sum-rate upper bounds for GICs with 
complex-valued channel coefficients. For symmetric complex GICs, where the phases of the cross-channel 
coefficients are the same but allowed to be different from those of the direct-channel, our study is motivated 
by the well-known example in [ 16] where the sum capacity is 4 log(l + 2 P) when the common direct- 
and cross-channel coefficients are 1 and y/—l, respectively. In sharp contrast, the sum capacity becomes 
just log(l + KP) when the channel coefficients are all 1. Hence it would be interesting to trace the 
trajectory of our upper bounds between the two extreme points, which implies that there could be a room 
for performance gain achievable by sophisticated schemes including interference alignment and structured 
codes when the phases of direct and cross-channel coefficients are sufficiently different. Then, the following 
intriguing question naturally arises: Can we always do better by exploiting the phase difference of the 
direct and cross-channel coefficients? To answer this question, the symmetric case is not appropriate 
because the cross-channel coefficients are already aligned in this case. 

Accordingly, we introduce a “semi-symmetric” GIC, where complex cross-channel coefficients for each 
user are allowed to be different in contrast to the symmetric case but all users are restricted to experience 
the same SNR and INR. This more general semi-symmetric GIC includes the above symmetric real 
and complex GICs as special cases. For the three-user case, we find that there are “good” and “bad” 
conditions for potential performance benefits achievable by sophisticated schemes, yielding a relevant 
conjecture on certain conditions for such good and bad phase offsets among the direct-channel coefficient 
and two different cross-channel coefficients. Interestingly, the bad conditions coincide with those of the 
DoF result from [26 Thm. 3] in the high SNR limit. Therefore, it turns out that a large phase difference 
between the direct and cross-channel coefficients does not suffice to achieve a substantial performance gain. 
This suggests that the good conditions on the phase offset may deserve attention to design sophisticated 
interference management schemes. 


C. The Organization of the Paper 


The remainder of this paper is organized as follows. Section II describes the channel model of the A'- 
user GIC that we study. In Section III, we derive new upper bounds on the sum capacity of the three-user 
GIC. Section TV generalizes the three-user bounds to the A'-user GIC, provides closed-form formulas 
of our upper bounds for the A'-user symmetric case, and also studies sum-rate behavior of the A'-user 
real GIC. In Section |Vj we investigate sum-rate behavior of the A'-user complex GIC by introducing the 


semi-symmetric case. We conclude this work in Section VI. 

Notations : We use X for a random variable and X n for a random sequence. Also, rr\ denotes the 
variance of X. For c G C, let 93(c) denote the real part of c, and CJV(0 ,1) denotes the zero-mean 
circularly symmetric complex Gaussian distribution. 
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II. Channel Model 

The A'-user complex GIC with constant channel coefficients can be defined by 

K 

Y k = 'y ] hkiXi + Z k (1) 

Z=1 

where X k G C is the channel input for user k, subject to an average power constraint P k , h ki G C 
is the channel coefficient from transmitter i to receiver k in which h kk = 1 for k = 1, 2, • • • , K, and 
Z k ~ CA/"(0,1) is drawn from the circularly symmetric complex Gaussian noise process that is i.i.d 
over time and independent of the channel inputs. The channel coefficients remain constant during the 
transmission period and are known to all transmitters and receivers. Since every A'-user complex GIC 
can be transformed to the standard form in (jl) with the same capacity region, taking only the normalized 
direct-channel coefficients into account involves no loss of generality. 

Let Mi, ..., Mk be independent, uniformly distributed messages over [1 : 2 nRl ],..., [1 : 2 uRk ], and 
let X™ G X,..... X\ G X K and Yj" G y i,..., Yg - y k be the random sequences induced by 
encoders enc^ : [1 : 2 nRk ] —> X k and the channel, respectively, where X \,..., X K are the codebooks 
with \X k \ = 2 nRk , where the channel input X k satisfies the average power constraints of P k such that 
|| X k \\ 2 < nP k ,\/k. A rate tuple (Ri, ..., Rk) is achievable if there exists a sequence of ( 2 nRl ,..., 2 uRk ,ri) 
codes with lim n _ > . 0O Pr " :> = 0, where I :> ! : ' n) is the average decoding error probability. The capacity region 
is the closure of the set of all achievable rate tuple (i?i,..., Rk). The correlation among the Gaussian 
noises is irrelevant since the capacity region of GIC only depends on the marginal distributions of Z k , 
i.e., Py k \x u ...,x K , for all k. 

Throughout this paper, the subscript G indicates X k = X kG ~ CAf(0, P k ) so that all other variables 
including X k become complex Gaussian distributed. For instance, Y kG = Yln=\ h k iX iG + Z k for all k. The 
user indices must be understood as modulo K such that X K+] = X } . For the symmetric GIC, SNR and 
INR are defined as SNR = P and INR = |g| 2 -P, respectively. 


III. Three-User Gaussian Interference Channel 
The standard channel model of the three-user GIC can be given by 

Y\ = X\ + h\ 2 X 2 + h 13 X 3 + Zi 
Y 2 = X 2 + h 23 X 3 + h 2 \X 1 + Z 2 

Y 3 = A"3 + h 3 1 X i + h 32 X 2 + Z 3 . (2) 


In order to derive useful upper bounds on the sum capacity of the three-user GIC which are amenable to the 
more general A'-user case, we utilize the Etkin-type and the change-of-interference bounding approach in 
a separate or joint fashion. In this section, we will provide three sum-rate upper bounds, in which the first 
bound is given by generalizing the change-of-interference approach in |8], [|9, Thm. 3], a time-sharing 
parameter with cardinality 2 was used on genie signals, for the there-user case. For the second upper 
bound, the Etkin-type genie signals are used by constructing a new genie-aided channel in conjunction 
with the conditional worst additive noise lemma |8j (see also @), which is a conditional version of the 
worst additive noise lemma [34]. The last upper bound is to jointly make use of the above two bounding 
approaches. 
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A. Change-of-Interference Bound 


The Z channel upper bound in [ |T0| Thm. 1] was naturally extended in [12]], [13] for the three-user case 
as follows: 


M + R 2 + R-, < \{l(X lG - Y 1G \X 2G , X 3G ) + I(X 1G - Y 1G \X 3G ) 

+ I(X 2G - Y 2G \X 3G ,X 1G ) + I(X 2G - Y 2G \X 1G ) 

+ I{X 3G - Y 3G \X 1G ,X 2G ) + I(X 3G - Y 3G |A 2G )} (3) 


for channel coefficients satisfying \hi 2 \ 2 < 1, \h 23 \ 2 < 1, and |/i 3 i| 2 < 1. Permuting the user indices, we 
obtain 3! such bounds in total. The first upper bound that we derive is given by modifying (3|) with the 
change-of-interference genie-aided approach in [ 8 j, [9j Thm. 3]. Let U k , k = 1,2, 3, denote genie signals, 
which we also call change-of-interference variables, defined as 


U\ — h\ 2 X 2 + h 33 X 3 + W\ 

U 2 = h 23 X 3 + h 2 \X\ + W 2 

U 3 = h 33 Xi + h 32 X 2 + li '3 (4) 

where the additive noise W k is distributed as CAf(0, o‘( V/ ) with a 2 V/ < 1 , correlated to Z k with correlation 
coefficient p Wk (i.e., E[Z k W k \ = Pw k &w k ) but independent of everything else, for k = 1,2,3. 

Conditioned on the change-of-interference variable £/[' for the case of user 1, the arbitrary random 
sequence hi 2 X^ + h\ 3 X 3 (interference signal to user 1) is replaced with the i.i.d. Gaussian random 
sequence W™, which is the main role of the change-of-interference variables. Replacing certain AT, AC, 
and AT in the side information terms of ([3) with LC, U 2 , and U 3 , respectively, we can get the following 
result. 


Theorem 1. The sum capacity of the three-user complex G1C is upper-bounded by 

R\ + R' 2 + R'i < \{i(Xi G -, y 1g \x 3G , u 1G ) + /(ATc; y ig \x 3G ) 

+ /(A 2G ; Y 2G \Xi G , U 2G ) + /(X 2g; Y 2G \X 1G ) 

+ /(X 3G ; Y 3G \X 2G , U 3G ) + /(X 3G ; Y 3G \X 2G ) 

+ I(U lG - Y 1G + Vws\X 3G ) + I(U 2G ; Y 2G + V Wl \X 1G ) 


+ I(U 3G -Y 3G + V w fX 2G )} (5) 

for all channel coefficients and {Wi, W 2 , W 3 } satisfying 

\h\ 2 \ 2 < 1 , |/^ 23 | 2 < 1 , \h 3 f -< 1 ( 6 a) 

a v Wl — l^ul 2 &z 2 -w 2 (bb) 

a v W2 — \h23\ 2 &z 3 -w 3 ^c) 

a v W3 — l^ 3 i 1 2(j2 z 1 -w 1 (bd) 

where Vw k CM ( 0 , a 2 Vk] Zk _ Wk ) for all k and 


Ywt = \j\hn\ “ — O’Vw-j f^Zn-Wn bVl 
Yw 2 = \j |^23h 2 — a Vw 2 a Z 3 -W 3 Yw 2 
Vw 3 = \J\h 3 i\ 2 — &Vw 3 a Ii - Wi Yw 3 ■ 

Permuting the user indices (i.e., changing the order of the users), we obtain 3! such bounds in total. 
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Proof: Refer to Appendix [A] □ 

Remark 1. Comparing the bounds in Theorem [7] and the bound in (3j), we can see that the more general 
side information Ui,U 2 , and U 3 (noisy interference) than X 2 , X 3l and X 1 (noiseless interference) can 
tighten upper bounds at the cost of the penalty terms I(U\ G \ Y\ G + Vw 3 X 3G ) +1(U 2G : Y 2G + VV, \Xkj) + 
I(U 3G ]Y 3G + Vw 2 \X 2 g) in (5)- Hence the bound in Theorem 1 improves upon (3) at a certain range of 
channel coefficients but also degrades due to the penalty terms and the constraints in (6b) - (6d) at some 
other range, as will be shown later in Fig. [2] 


B. Etkin-Type Bound 

The second sum-rate upper bound to be derived in the following is inspired by the Etkin-type genie- 
aided approach [j2j-|5j for the two-user GIC. A generalization of this approach for more than two-user 
cases is given by [3] in the standard form of JA =1 R, < JA = 1 1(X iG \ Y iG , S iG ). However, this type of 
genie-aided bound is tight only in the noisy interference regime, where cross-channel coefficients are 
very weak and transmission power should be restricted, and becomes quickly loose by construction, i.e., 
even quite larger than the interference-free upper bound as cross-channel coefficients get close to 1. It 
is non-trivial to design a different genie-aided channel from the standard form, Jff =1 1(X iG ;Yi G , S iG ), 
which should yield a new genie-aided upper bound useful for the moderately weak interference regime 
rather than the noisy interference regime. In order to construct such a new form of genie-aided channel, 
we first define the genie signals for the three-user case as 

S\ = h 32 Xi + h 32 X 2 + N\ 

5 2 = h\ 2 X 2 + h\ 3 X 3 + N 2 

5 3 = h 23 X 3 + h 2 + N 3 (7) 

where N k is distributed as CA2(0, aff with a% t < 1, correlated to Z k with correlation coefficient p Nk 
(i.e., E [Z k Nf\ = p Nk a Nk ) but independent of everything else, for k = 1,2,3. 

With the above definitions of genie signals and additive Gaussian noises, the following result presents 
a new type of genie-aided upper bound. 

Theorem 2. The sum capacity of the three-user complex GIC is upper-bounded by 

R 1 + R 2 + R 3 < I(X 1G - y 1g ) + I(X 2G - y 2C , S 2 G \X 1G ) + I(X 3G - Y 3 G \X 1G , X 2G ) (8) 


for all N 2 satisfying 

\hi 3 \ 2 < <Jv N2 < 1 or \h 2 3\ 2 < < 1 

where 

Vni ~ ^( 0 . 

V N2 ~ CJ\f(0, a N2 1 Z2 _ h23h - 3 ijv 2 ) 

V Nz ~ CAT( 0, cr^i z 3 _ h3lh -i N3 ) 

and 

V Ni ~ C7V(0, <J Zi | Nl _ h32h -i Zl ) 

Vn 2 ~ CJ\f(0, cr Z2 1 N2 _ hl3h -i Z2 ) 
v n 3 ~ CAf( 0, a Zs | N3 _ h2lh -i Z3 )- 

Permuting the user indices, we obtain 3! such bounds in total. 


(9) 

( 10 a) 

( 10 b) 

(10c) 

(Ha) 

(lib) 

(He) 





Proof: Refer to Appendix B. 

It follows from (90) that, for the first condition in (|9), we can rewrite (8j) as 
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□ 


Pi + R 2 + P 3 < log 1 + 


Pi 


\h 12 \ 2 P 2 + \h 13 \ 2 P 3 + l 


+ log 


\hi2 

\ 2 P2+\h 13 \ 

\ 2 Ps + < 

1 + | h 23 hi 3 | 

W N2 -2K{\h 23 h;i\ 

\ 2 Pn 2 <?n 2 } 


log 


P 2 + |^23| 2 -P3 + 1 — 


\hl 2 P2+h23hl 3 P3+pN 2 a 'N2\ ^ 
\h 12 \ 2 P 2 + \h 13 \ 2 P 3 +C7 2 No 


\his\ 2 Ps + 0VW 


+ log (1 + P 3 ) 


( 12 ) 


/ 


where 


°Vjsr, — 


iv 2 



Pn 2 &n 2 ~ h 23 h 13 a% 2 \ 

2 

1 + \h^hj\ 

l 2 < - 20i{\h 23 hri 

\ 2 Pn 2 &n 2 } 


(13) 


For the second condition in (j9j), we can also get the following expression: 


Ri + R -2 + P3 < log 1 + 


Pi 


\h 12 \ 2 P 2 + \h 13 \ 2 P 3 + l 


+ log 


1 hi2 

\ 2 P2+\hi 3 \ 

1 2 P 3 + a 

2 

n 2 

a N 2 + 1 ^ 13 ^: 

-1 

23 

2 — 293 { \hi 3 hf 3 \ 

2 Pn 2 @n 2 } 


log 


( JD 1 |L | 2 p 11 \ 

+ l /Z23 l + 1 


I ^231 2 -^3 + a v' 


V 


JV 2 


log (1 + P 3 ) 


(14) 
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where 


cr 


Vi 


= 1 



Pn 2 &n 2 — h 13 h 23 \ 

2 

Pn 2 + 1 h 23 h^ 3 

\ 2 -2d\{\h l3 h^\ 

\ 2 Pn 2 °n 2 } 


(15) 


Therefore, the upper bound in Theorem j2] is given by the minimum of (12) and (14) over all parameters 
() N , 2 and o N2 satisfying Q. For the symmetric case, (12) and (14) are equivalent. Interchanging the user 
indices, we have additional (3! — 1) bounds as well. 

Remark 2. The standard genie-aided channel is different from our genie-aided channel in (<§]) where 
only a single receiver (receiver 2) is provided with the corresponding genie signal (S 2 ), apart from the 
condition on Xf. In general, the most difficult part to find a single-letter expression for genie-aided upper 


bounds is how to handle the negative non-Gaussian entropy terms, as well addressed in [35]. To this end, 


the key step in the proof of Theorem [2] was to carefully design the genie signed Sf and the additional 


side information Xf so as to apply Lemma 1 to —hfSfiX'f) — h{Yf \Xf. Xf, S‘f) in (25), thus replacing 
h(S 2 \X 2 ) with the Gaussian entropy nh(Z 2 — h 23 hfiN 2 ). 


For the special case where the cross-channel coefficients are all unity, it is well known [30] that the 
time division scheme achieves the sum capacity. We can easily show that the upper bound coincides 
with the time division lower bound in this case. Letting N 2 = Z 2 for (8), we get h(Z 2 — h 23 hf 3 N 2 ) = 
h(Y 2 G \Xig, S 2 q ) = 0. Then, (12) reduces to P sum < | log(l + 3P) for the symmetric real case. Therefore, 
our upper bound is tight for this special case. 


Notice that the generalized Z-channel bound in [36} has the same mutual information terms as Theorem 
[2] However the constraints are different from each other, and iV* in our bound are not restricted to have 
the same marginal probability as Z % , which leads to different bounds in general. 






















C. Hybrid Genie-Aided Bound 

We point out that the previous upper bounds in Theorems jT] and [2j are restricted to the “mixed” 
interference channel. The mixed (i.e., weaker and stronger interference signals than the intended signal) 
interference channel is defined such that at least one of the amplitudes of cross-channel coefficients 
\h ki \,k T i . should be less than or equal to 1, as shown in ( 6 a) and (9). Unlike the mixed interference 
regime in the two-user case [4], our mixed interference scenario includes the weak interference regime 
as well. Furthermore, the first bound in Theorem [T] in fact comes from the existing two-user bounds and 
hence rather loose in the three-user real GIC, while the second bound in Theorem [2] is outperformed by 
the first one when there is even small phase offset between direct link and cross link in the complex GIC, 
as will be shown later in subsection |V-A[ Therefore, we need the third bound which is valid irrespectively 
of channel coefficients. 

Inspired by 0, we first introduce a time-sharing operation with respect to side information at the three 
receivers. Let Q denote a time sharing random variable. In order to conduct time sharing on the genie 
signals S k and U k with \Q\ = 3, we define a new genie signal Tf as 


0 

Tf = i SI 


uj: 


if Q = 0 
if <2 = 1 
if <2 = 2 


(16) 


for k = 1,2,3. The order of 0, S k ,U k with the equal probability does not change a resulting capacity 
bound. The random sequences TJ? are conditionally independent given 0. Using Fano’s inequality and 
letting Pr(<2 = 0 ) = Pr (Q = 1 ) = Pr(<2 = 2 ) = 1/3, we can write 


n(yR\ T R 2 T R 3 — 3c,, 


< / W; 1?) + /(AT; YT) + I(x »; y 3 n ) 

< / W; Yi, T n + J(X 2 "; Yf, T 2 ) + J(X 3 "; Yf, Tf 


(a) 


< /(AT; Yf, T?\Q) + I(X 2 "; Y?, T 2 \Q) + /(AT; Yf, T?\Q) 
3 

V {/(AT; Y?) + I(Xl, Yi, Si) + I(Xi\ YS, Ui) 


1 

3 


( 6 ) 1 
< - 
“ 3 


1 

< - 
“ 3 


k= 1 
3 


V Y t ") + I(Xi- Yi, Si) + I(Xi ; Yi\u;: 

k= 1 
3 

E {/(-XJ; Yi) + I(Xi; Yi, + I(Xi; Yi\U )) 


(17) 


k =1 


where (a) follows from the independence between X% and Q, and (6) is from the independence between 
AT and U£ all by definition. Starting from (17]), we can get the third upper bound for the three-user case 
in the following hybrid fashion. 


Theorem 3. The sum capacity of the three-user complex GIC is upper-bounded by 

R\ + R'2 + P,3 < ^{/(Ai G ; Y 1g ) + J(X 2G ; X 2 g, S 2 g|X 1g ) + /(X 3G ; Y 3G \U 3G ) 

+ /(X 2G ; Y 2G ) + /( X 3 g; Y 3G , S 3G \X 2G ) + I(X ig; Ti G \Ui G ) 

+ J(X 3G ; Y 3G ) + J(X 1G ; Y\ G , 5 1G |X 3G ) + /(X 2G ; Y 2G \U 2G )] 

+ min{/ 0 ,/i} (18) 

where 

/° = ^{/(Uig; Pig + Tv 3 ) + /(£/ 2G ; X 2G + PvJ + UU 3G - Y 3G + Vn 2 )} 


(19) 
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J(X";>'") •— 

—/(xj ; y" 

\u?)\ 

?I(Xf,Y™,S* 

1 ^3 ) 

i(x:-,y:)-- 

■-i(x:-y: 

\u:)<) 

(}i(x:-y:,s: 

l*T) 

/(A";F").- 

--I(Xl,Yl 

\u;/ 

" ] *I(X"-,Y n 3 ,S” 

|X") 


Fig. 1. Graphical representation of the relation between mutual informations in Theorem [5] The solid lines correspond to the chain of 
differential entropies aix a 2 x —> a 3 x given by appropriately pairing of positive and negative entropies in (27 1 , where X = A , B. 


with the set of noise terms (A r i. N 2 ,N 3 , W \, W 2 , W 3 ) satisfying 

a V Wl > a N 2 i °Vjv 2 - I^13| 2cr l 3 -W 3 
— a Af 3 ) ^VjVo — 


cr 




2 \ 2 2 \ | 7 |2 2 

a v w% - - 1^321 &Z 2 -W 2 


where 


V W 3 

V Nl = 
Vn 2 = 
Vn 3 = 


(20a) 

(20b) 

(20c) 


2 - cry 2 cr|„_ w „ 14, 


32 


JVi 


1 Z 2 -W 2 v Xi 


13 


2 a VN 2 a Z 3 -W 3 V N 2 


21 


2 a VN„ a Z 1 -W 1 Vx 3 


and 14, are given in (10a) - (10c), and 


h = \ 

with (Ni, N 2 , N 3 , Wi, W 2 , W 3 ) satisfying 


1 g; Yig + Vf 3 ) + I(U 2G ; y 2G + KJ + I(U 3G ; 4 3G + V^ a 


a : 


a 


a : 


.2 

> 

2 

°Wi’ 

2 

CTy/ 

4r 2 

> 

^23 

|V 

,2 

w 2 

> 

2 

2 

CTy/ 

4t 

> 

^31 

|V 

,2 

w 3 

> 

2 

°W 3 , 

2 

cry/ 
^1 

> 

^12 

|V 


-ITi 


( 21 ) 

(22a) 

(22b) 

(22c) 


where 


Vk = yj\ 

h\ 2 

1-2 _ y ' 

a V { fi a Z 2 - W 2 v n 3 

Vb = f\ 

^23 

1-2 _ ^--2 _2 y > 

G V ' N f J Z 3 - W 3 v n 2 

Vk = f\ 

^31 

1-2 _ .T-— 2 ,-2 T/' 

^v^zi-wr *4 3 


and Vf are given in (11a) - (11c). Permuting the user indices, we obtain 3! such bounds in total. 
Proof: We can bound R\ as 

n{Ri-e n )<I{X^Y?\U?) 

= h{Y?\U {*) - h(Yf\X 7 f U?) 

= h(Yf\U 7) - h{h 12 X% + h 13 X% + Z?\h 12 XZ + h 13 X% + Wf) 

= h(Yf\U i") - h{h 12 XS + h 13 X% + V^) + h{U T) - n/^i - Wi) 

= /f(A4 + Z” - WJTO - /i(/ii 2 X 2 " + h l3 X% + V£J + /i(t^) - n/i(Zi - Wi). (23) 
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and also R 2 as 


n(R 2 -e n ) <I(X2-,Y 2 n ,SZ\X?) 

= I{XS] s%\X?) + I(X 2 ; Y 2 \X™, SS) 

= h(£%) - MS? 1*2) + h(Y? I AT, S 2 n ) - h(Y?\ AT, A7, £%) 

= h{h l2 X% + h 13 X% + N?) - h(h 13 X 3 " + JV 2 n ) 

+ + ^ 23 ^ + Z%\S2) ~ h(h 23 X% + Z 2 | h 33 X 3 + 7V-) (24) 

= h{h 12 X% + fr 13 X 3 n + N£) - h(Z% - h 23 h^ 3 N 2 ) 

+ h( A7 + h 23 X% + Z2\£%) - h(h 13 A7 + V&) (25) 

(6) 

— h(S%) — nh(Z 2 — h 23 h 13 N 2 ) + nh(X 2 Q + h 23 X 3G + ^I^g) — h(h 33 X^ + V^ 2 ) (26) 


where (a 
from 


) follows from applying Lemma l]in Appendix A to h(h 23 Xg + Z 2 \ h 13 X^+N 2 ), and ( b ) follows 
Lemma 1], 


Using (23) and (126), we can write 


I(X T; n n ) < n/i(y 1G ) - /i(/h 2 X 2 " + h 13 X£ + Z%) 


— &iB 


/(AT; V^|C7T) = h ( X i + Z i ~ W?\U?) - h(h 12 X% + h 13 X% + 


”“v- 

A 

— OLQB 


— &2B 


+ h(h 12 XZ + h 13 X 3 n + W?) -nh{Z 1 - W 3 ) 


-v- 

A 

— Oil A 


J(X 2 n ; Y?, S2\X?) < h(h 12 X% + h l3 X% + N2) -nh(Z 2 - h 23 h^N 2 ) 


— “2 A 


+ nh{X 2G + h 23 X 3G + Z 2 |S 2G ) - /i(/ii 3 X 3 n + U^ 2 ) 


= «3S 


/ W? y 3 n ) < nh{Y 3G ) - h(h 3l X? + h 32 X% + Z%) 


= “4 B 


I(X 3 "; y 3 n |U 3 n ) = M* 3 " + Z” - W?|E£) - /ifai*" + /laaXJ + U^ 3 ) 


-v- 

A 

— 0:3 A 


— Oi 5B 


+ h(li 3 1 A 7 + h 32 X% + W 3 ") -nh(Z 3 - w 3 ) 


— OL±A 
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/(AT; >?, S r|^) < ^(/iaiAT + h 32 X% + N?) -nh{Z 1 - h^h^N, 


-V- 

A 

— &5A 


+ nh(Xi g + h\ 2 X 2G + ■^iI'S'ig) — hih^X^ + V^J 


-V- 

A 

— OLQB 


/ W; *7) < ^(^ G ) - + ^2lAT + z?) 


= «7B 


/W; = /iW + ^2 - WTI^2) - + /z 21 A7 + v£j 


— &6B — OtgB 

+ h(h 23 X™ + h 21 X? + W%) -nh(Z 2 - W 2 ) 


-V- 

A 

— OL 7 A 


/(A"; y 3 n , S£\X?) < h(h 23 X? + h 21 X? + N 3 n ) —nh(Z 3 - h 31 h^N 3 


-V- 

A 

= OLg A 


+ nh(X 3G + h 33 XiQ + Z 3 \S 3G ) — h(h 2 \X ” + V^ 3 ). 


(27) 


-V*- 

A 

— &9A 


Using the worst additive noise lemma and its conditional version in [8j Lemma 3], we can upper-bound 
the multi-letter expressions of oi\a — a lb, ol 2 a — a 2 B, and a 3 A — a 3 B as 


— (oiia ~ ol ib) < h{h\ 2 X 2G + h\ 3 X 3 G + W\) — h(hi 2 X 2G + h\ 3 X 3G + Z\) 
n 

X 

— (« 2j 4 — ch 2 b) < h{h V2 X 2G + h\ 3 X 3 G + N 2 ) — h{h\ 2 X 2 G + h 33 X 3G + UwJ 

— (a 3 A — « 3 b) < h(X 3 G + Z 3 — W 3 \U 3 g) — h(X 3G + Z 3 — W 3 + Vn 2 \U 3 g) ~ log \h\ 3 \ 
n 


(28) 

(29) 

(30) 


where the last bound is valid for the conditions in (20a). Similar to (83), the second term in the right-hand 
side of (30]) can be expressed as 

h(X 3G + Z 3 -W 3 + V N2 \U 3G ) 

= h{X 3G + Z 3 -W 3 + Vn 2 \U 3G ) - h(X 3 G + h u l V N2 ) + h(X 3G + h^V Na ) 

= h{X 3G + Z 3 -W 3 + V N2 \U 3G ) - h{X 3G + Z 3 - W 3 + V N2 ) + h{X 3G + h^V Na ) 

= h(Y 3G + V N2 \U 3G ) - h(Y 3G + V N2 ) + h{X 3G + 

= -I{U 3G - Y 3G + V N2 ) + h{X 3G + hijV N2 ) (31) 


since a:-, > 0 due to the second condition in (20a). 

Vt~ 


N 2 


Plugging pTj ) into ( J30| ), we get 

1 


n 


(«3 a ~ & 3 b) < h(X 3G + Z 3 — W 3 \U 3G ) 

- h(h 13 X 3G + V N2 ) + I(U 3G - Y 3G + V Na ). 


(32) 


In the above inequality, I(U 3G ; Y 3G + V N , 2 ) is a penalty term due to the conditional worst additive noise 
lemma. Repeating the same procedure to a 4 A — (Un through a 9 /i — a 9B , we arrive at (T8]) for I 0 and the 
conditions in ( |20a[ ), (20b), and ( |20cj ). 

As for Ji and the other conditions in (22aJ), (22b), and (22c)), it suffices to relate ot \a — ch 2 b and a 2 A~ctiB 
instead of «ia—«ib and a: 2 ,i—a 2 «, to replace the negative entropy terms -nh(Z 2 -h 23 h^N 2 )-h{h 13 X^+ 
V}} 2 ) in /(AT?; F 2 n , |A”) in (27) with —nh(N 2 — h\ 3 fi 2 3 Z 2 ) — h(h 23 X 3 + U(”) as already done in the 
proof of Theorem |2j and to follow the above same steps. This completes the proof. □ 
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Remark 3. Constructing the relation shown in Fig. [7] among mutual information terms to handle the 
negative non-Gaussian entropies was the key step to derive the upper bound in Theorem [I] by combining 
Etkin-type and change-of-interference approaches. The resulting upper bound is not restricted to the mixed 


interference regime any longer owing to the careful matching of o :i/ \ — o 3 b in (27). Notice that there are 


several other possible matchings of positive and negative non-Gaussian entropies due to the conditional 
worst case noise lemma, each of which clearly yields a valid upper bound. Nevertheless, such bounds 
turn out not so useful (i.e., not tighter than the existing bounds). 

Remark 4. On one hand, notice that it is generally possible to find a tighter upper bound by letting all 
noise terms correlated to each other as in the existing bounds [3], [13], [36]. On the other hand, the 
noises Wk and Nk in our bounds are not restricted to have the same marginal distribution as Zk- This 
interesting tradeoff will be addressed in the context of the symmetric G1C and numerical results in the 
following subsections. 


Eventually, our new upper bound on the capacity of the three-user complex GIC is given by the minimum 
of four upper bounds given in Theorems |T[ |2j [3], and the bound in (3j. This will be the same case in the 
A'-user case. All the upper bounds in this section are useful since they have their own ranges in terms of 
channel coefficients and SNR, where one of them is tighter than the others. Finally, it should be pointed 
out that the upper bounds in this work may be further tightened by using techniques in the two-user case 
[j9] Thms. 4 and 5], 


D. Symmetric Case: Simplifying Upper Bounds 

In this subsection, we focus on the special case of the symmetric GIC since it is sometimes useful to 
provide new insights into understanding the capacity. The A'-user symmetric complex GIC with constant 
channel coefficients is given by 


Y k = X k 


9 2^Xi 

i^k 


(33) 


where Pk = P for all k. The amplitude and phase of the symmetric cross-channel coefficient g are denoted 
by \g\ and off), respectively. 

For the symmetric case, we evaluate sum-rate bounds of the symmetric three-user GIC at finite SNR to 
see how useful the derived upper bounds are to investigate the sum-rate behavior, compared to the existing 
bounds. We will use the normalized symmetric rate for which the sum rate is normalized by the number 
of users and the number of dimension (real/complex) and hence its unit is bits/channel use/user/dimension 


throughout this work. A generalization of the Han-Kobayashi coding scheme [38] has a prohibitively large 


complexity as the number of users increases, since each user should decode a different common message 
for every subset of non-intended receivers. Despite the overwhelming complexity, the resulting achievable 
rate seems to be outperformed by interference alignment and structured codes. Therefore, throughout 
this paper, we will use the simple lower bound that is given by the maximum symmetric rate of treating 
interference as noise, time division (with power control), and simultaneous non-unique decoding schemes. 

In the following, we briefly review some existing upper bounds to compare the new upper bound with. 
First, the Kramer upper bound [ |T0| , Thm. 1] and ETW upper bound [2] on the symmetric capacity of the 
symmetric two-user GIC can be used as a simple upper bound for the A"-user case, as shown in [30). 
Deactivating all but any two users, the symmetric capacity for the general A'-user GIC is upper-bounded 
by the the two-user case since removing interferes only increases the symmetric rates of the selected 
users 1 and 2. Fet G' sym denote the symmetric sum capacity of the symmetric GIC. The Kramer upper 
bound on the symmetric capacity of the two-user GIC can be written as [jTOj Thm. 1] 


r < 

^sym _ 


ilog(l + P) + |log(l + IT ^p), \g\ < 1 
Mog(l + P + \g\ 2 P), \g\> 1 


( 34 ) 
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The ETW upper bound is given by [2| 

Csym < log ^1 + \g\ 2 P + 


P 


i + \g\ 2 P 


(35) 


The Kramer bound is extended in [ 131 to the three-user GIC by using the LMMSE estimation based 
proof. For the symmetric three-user case, the generalized Kramer upper bound can be simplified as follows: 

P + 1 


C'sym < log P + 2\g\ P + 1 + log 


(|9| 2 -P+ 1)(|9|V+ 1 - TJ+h") 

\g*{g + l)P + P*\ 2 
2\g\ 2 P +1 


+ log I P + \g\ 2 P + 1 


for p satisfying k »•][;•;][?]< 1, where p is the correlation coefficient between Z v and Z 2 
satisfying [g* g* ] [ p l {] 1 [ 9 g ] > 1, we have 


C'sym — log 


P + 2\g\ 2 P + 1 


+ log P+ \g\ 2 P + 1 - 


\g*(g + l)P + p 


* 12 


(36) 
For p 

(37) 


1-H 2 J V 2|g| 2 P + 1 

In fact, the above two bounds coincide with each other for the symmetric GIC. Thus we will only consider 


in the following. Meanwhile, a generalized ETW upper bound for the three-user symmetric GIC is 
proposed in [3] Sec. VII-C] using the vector genie S_ iG defined in Table II in |3] and allowing correlation 
over all noise variables, as follows: 


3 


C'sym < > I(X iG ;Y iG ,S iG ) 


(38) 


2=1 


for (£,p, 1? /i 2 ) satisfying Cov([Z! gpiWu} T \W 12 ) — Cov([gpiWn g^W^Y) + 0, where S is the 
covariance matrix of the noise random vector [Z- v W n W 12 Y, W\j,j = 1,2, are the additive noises 
in S_ iG , and // ? denotes the variance of Wij. 

For the symmetric case, we can naturally simplify our bounds to avoid the numerical optimization over 
all possible ranges of the parameters. In this paper, we only simplify the bound in Theorem [3j which 
reduces to 


C'sym < log 


P + 2|g| 2 P + 1 


0~, 


+ log 


log 


' Z-N 

P+\g\ 2 P +1 


2|g| 2 P + fljy 
2|f?| 2 P + l 


+ log 


\sf_ (g+l)P+PT\r a N \ 2 

2 |g| 2 P+o-^ 


<7 


+ log 


m 2 p+^w 

2 |^| 2 P + a v w 
P + a 'z-w 


\Pw a w~ IJ w\ 2 

2|g| 2 P+cr 2 ,. 


Z-W 


\„V2r> 1 ^-2 \gpw&w—g^ w l 

+ 1 r + a V N 2\g\^P+o^ 


(39) 


where the Gaussian noises Z, W, N are irrespective of user index k by symmetry. 

To derive the simplified bound as a special case of (39), we will follow the technique in |9], which 
exploits the fact that the equalities in the worst additive noise lemma in [|34| and its conditional version 


in [8] trivially hold true when a~ z = 0 as well as when X n = X" (and U n = U" for the conditional 


version). Therefore, those lemmas incur no loss in tightness of the resulting bounds if one can let o\ = 0. 
Then we have the following result. 


Theorem 4. The sum capacity of the three-user symmetric GIC is upper-bounded as 

C sym < min (R 0 , Rf) 


(40) 


where 


R 0 = min R 

CTN 


( 41 ) 
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subject to 0 < (\pw\i \pn\,&Wi <Pv) < 1 
&w — 1 
Pw = 2<r^r — 1 

Pn = 4|<?| 2 (W - o N ) - yj{l - ( 2\g\)-i)o - N 2 + (1 + (2^K 2 + (%jj^) 


(42a) 

(42b) 

(42c) 

(42d) 




/-?! = min R 

PN 


(43) 


subject to 0 < (|pvk|, |pat|, oqy, &n) < 1 
o-jv = 1 
= |pw| 


Pm = i/l 


1 + Piv 

~ 1 M r 


(44a) 

(44b) 

(44c) 

(44d) 


where 


F = log 


P + 2|p| 2 P + l 


) +log (p + l9 pp + 1 _k^_H0£±|M 


(45) 


Proof: We first consider (39) under the conditions in 


For the symmetric GIC, there are four 


parameters (p w , Pn, Am cr N ) and three inequalities including the two conditions in (20a) and the implicit 


condition (i.e., &w < 1) in (28) due to the worst additive noise lemma and its conditional version. Based 
on the argument in [|9j Thm. 6 ], we need to consider the equalities to optimize the parameters. Given on, 
we do the following steps: 


A3) 


Let of N = \g\ 2 (Jy N (i.e., a 2 ^ = 0) to satisfy a 3A - a 3B = -n log 

given ( 42b) and ( [42c) . 

Substituting (42b) - (42d) into (39), we have R 0 . 


Al) Let a'ly = 1 to satisfy 0 : 1,4 — oii B = 0 in (28), which is simply (42b). 

A2) Let ol w = 0 % to satisfy a 2A — ot 2B = 0 in (29), which yields (42cf given (42b). 

r 2 _ i„i 2_2 „ ^2 _ rn ^ - - in (30), which yields (42d 


Similarly, we can do the same things for the conditions in (22) as follows: 
Bl) Given p N , let o 2 N = 1 to satisfy cu 1A — a 2B = 0, which is simply (44b). 


B2) Let at = ojy to satisfy a 2A — a\ B = 0, which yields (44c) given (44b). 


B3) Let o 2 Vn = \g\ 2 a°y N (i.e., o^, = 0) to satisfy h{Y 3 G \U 3G ) - h(gY 3G + Vf\U 3G ) = - log \g \ 2 (for more 
details, see the I± part in tfie proof of Theorem (3), which yields ( |44d| ) given (44b) and ( 44c) . 

Substituting ( |44b) - ( |44d[ ) into (39), we have Ri. □ 

We now show that R x reduces to the generalized Kramer bound in (37). It immediately follows from 


(44b|) - (44d) that \g\ 2 <7 2 z _ N a 2 z _ w = 1 — \pn\ 2 in (45), thus yielding that the objective functions in (43) 


and (37) are the same by just letting p N = p. It is easy to check that the constraints of Ri and the 
generalized Kramer bound can be rewritten as p < 2\g 2 — 1. Therefore, the two optimization problems 
are equivalent. This is not necessarily the case with R x . The main difference between R 0 and R , is that 
the noise N k in R 0 is not restricted to have the same marginal distribution as Z k , i.e., (44b)). 
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Fig. 2. Bounds on the sum capacity of three-user symmetric real GIC over 0 < g 2 < 1 when P = 10. 



Fig. 3. Bounds on the sum capacity of three-user symmetric real GIC over — 1 < a < 1 for P = 10. The new upper bound is given by 
the minimum of bounds in Theorems 1, 2, 3. 
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E. Numerical Results 


In what follows, we focus on capacity bounds for the symmetric (positive) real GIC, which has been 


widely used due to the simplicity of the resulting channel model (e.g., BO], [311). The behavior of sum-rate 
bounds for more general complex GICs will be deferred to Sec. V. 

Fig. j2j depicts the symmetric rates of the four upper bounds derived in the previous section and the 
lower bound for the three-user symmetric real GIC. For this symmetric case, the upper bounds in Theorem 
[1] and (j3j) reduce to |~9j Thm. 3] and [ 10} Thm. 1], respectively. Notice that any of those bounds does 
not contain the other bounds when complex channel coefficients are taken into account, as will be shown 
later in Sec. 0 

Fig. [3] compares our upper bound with the above two-user upper bounds, the generalized Kramer upper 
bound, the generalized ETW upper bound, and the simple lower bounds in the previous subsection for 
the three-user symmetric real GIC over — 1 < a < 1 at SNR = 10 dB, where a = = lo f P g p P • 

The new upper bound is shown to be tightest in the medium range of a by nature of the change-of- 
interference approach in Theorem |3j because the change-of-interference variables in (4|) are more general 
than Ai, A 2 , AT (i.e., noiseless interference as side information), as mentioned in Remark |T] This is 
consistent with [|9] for the two-user case. Namely, the change-of-interference approach improves upon the 
Kramer-type bounds in [10), [13) at a certain range of channel coefficients. 


As mentioned in subsection III-D we can see that the proposed bound coincides with the generalized 
Kramer bound in a certain range of a. This is quite interesting as the former does not impose correlation 
over all noise variables. The generalized ETW bound is tightest when a < 0.07, i.e., interference is very 
weak. 

Fig. [4] depicts the same upper and lower bounds over 0 < a < 2 at high SNR of 20 dB. Our upper 
bound is still tightest in a certain range of a and coincides with the generalized Kramer bound for 
a > 0.71. For this high SNR, the two-user upper bounds are tightest in two different ranges of a, 
respectively. A sophisticated lower bound based on lattice interference alignment using the compute-and- 


forward approach was proposed in [31). In particular, the readers are encouraged to refer to Fig. 7(a) 
therein for a tighter lower bound than the simultaneous decoding lower bound plotted in Fig. [4] for a > 1. 
Notice that g = I* 2 . Furthermore, the multiple access upper bound in [21] is valid only when \g\ > 1 


(i.e., a > 1) and is shown in [ |T3j Fig. 3] to coincide with the generalized Kramer bound in some range 
of g and to be quite loose in the remaining range. One may consider a trivial upper bound obtained by 
a multiple-access channel (MAC) formed by allowing the receivers to cooperate, which is also shown in 
[ T3| Fig. 3] to be in general loose relative to the other bounds. 

From Figs. [3] and (4j we observe that the gap between the upper bound and the simple lower bound over 
a certain range around g 2 = 1 is not significant. We will see in Sec. IV that the rate gap around g 2 = 1 
is still not significant at least for K = 4 symmetric real GICs. Moreover, the range of a over which the 
new bound is tightest tends to shrink as P increases. Comparing R 0 and Ri (equivalently, the generalized 
Kramer bound) in Theorem [4j we can see that the rate difference of the two bounds vanishes as P —>■ 00 
irrespectively of a 2 N . 


IV. JT-User Gaussian Interference Channel 

In this section, we generalize the upper bounds on the sum capacity of the three-user GIC to the K- 
user case. We first consider the A-user symmetric GIC and then the asymmetric case. A straightforward 
generalization of Theorem [I] and ([3) is skipped due to the space limitation. 


A. Symmetric Case 


In this subsection, we are interested in the symmetric case in (33), for which the three-user upper 
bounds in Theorems j2j and [3] can be naturally extended to the A-user case. For the K -user symmetric 
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Fig. 4. Bounds on the sum capacity of three-user real symmetric GIC over 0 < a < 2 for P = 100 (i.e., SNR = 20 dB). 


case, we rewrite the genie random variables in ([4) and (J7) as 

U k = gJ2 X * + W k 

i^k 

S k = gJ2 x i + N *- 

i^k—1 

With these definitions, we have the following generalization of Theorem [2] for the symmetric case. 
Theorem 5. The sum capacity of the K-user symmetric complex GIC in the weak interference regime, 


where \g\ 2 < 1, is upper-bounded by 

K K—l 

Y R k < j ( x ig; Y 1g ) + Y YkG , Skc\X\ G v ) + I(X KG - Y kg \X^ 1 ) (46) 

fc=l fc=2 

for all [N\ , N 2 , Nk) satisfying 

°v Nk > °N k+ i fork = 2,...,K-2 (47) 

> l^l 2 («) 

where 

VN k = N k \ Z k — N k . (49) 

Proof: See Appendix [Cj □ 


In order to obtain the K -user extension of Theorem [3} we need to generalize the relation of mutual 
informations for the three-user case in Fig. |T| to the A'-user GIC. The extension to the four-user case will 
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be given in Fig. 12 in Appendix D. The relation for more than four-user cases can be obtained in the 
same manner. We have then the following result. 

Theorem 6. The sum capacity of the K-user symmetric complex GIC is upper-bounded by 

I< K -1 

< I(X 1G] Fig) + Y kG , S kG \X^) 


k =1 


for all (Ni ,..., Nk, Wi, ..., Wk) satisfying 


k=2 

I ( Xrg ; F^c | Ukg) + I {Ukg] Ykg + Fv K ) 
tisfying 


<7 


Vw 1 — 


> o 


n 2 

2 


a vw - °N fc +i> k-2,...,K 


cr 


V N , 


: _j - 1^1 


(50) 

(51) 

(52) 

(53) 


where 


Yn k _ 1 = y Ifli _ 

Proof: See Appendix D. □ 

Remark 5. The “useful genie” upper bound in [3 : J for the symmetric three-user GIC defines a vector 
genie and imposes correlation over cdl additive noise variables. However, this approach makes it hard 
to compute the resulting outer bounds even in the symmetric four-user case. Specifically, not only we 
have R ( K ~ 1 ') complex correlation coefficients to optimize for the K-user symmetric case, but also matrix 
inversions and positive semi-definiteness tests of (K — 1)-dimensioned complex matrices. The dimension 
of the noise covariance matrix increases exponentially with K for the asymmetric case. Similar difficulty 


arises in generalizing the Kramer bound in [10 Thm. 1] to the more than two-user case due to the 
optimization of a positive-definite covariance matrix of jointly Gaussian noises by imposing correlation 
over all noise variables (e.g., see [13], [36] for the three-user case). In contrast, our noise variables 
defined in O are correlated only with Z t having the same user index, respectively. This is the same case 
with the other noise variables Wi in Theorem 1 The parameters to be optimized are (K — 1) complex 
correlation coefficients and (K — 1) variances. Therefore, we intentionally avoided the use of the above 
optimization of the noise covariance matrix as well as vector genie in this work. 


B. Closed-Form Upper Bounds for the K-User Symmetric GIC 

This subsection is devoted to find appropriate closed-form expressions of our upper bounds that do 
not involve the optimization of the covariance matrix of additive noise variables, which makes it hard to 
compute upper bounds on the capacity of the A'-user GIC unless K is quite small, as mentioned earlier. 
By exploiting an intrinsic structure of our upper bounds, we will simplify upper bound formulas so as 
to predict sum-rate behavior of the A'-user symmetric GIC in the large-number-of-user regime. Notice 
that the closed-form upper bounds in this subsection are given for the symmetric real GIC but they are 
straightforwardly extendable to the symmetric complex case. We begin with the following proposition 
based on Theorem 0 

Proposition 1. For the cross-channel coefficient \g\ < 1, a closed-form upper bound on the capacity of 
the K-user symmetric GIC is given by 

C„ < log (l + {K _ r ^2p +1 ) + >°« (i + ( K - !) p ) 

K—l 

+ 

k=2 


1 + 


\l-g\ 2 P (k-l)P+l 


i-M 2 


kP + 1 


(54) 
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Fig. 5. Closed-form upper bounds on the symmetric rate of the 7\-user symmetric GICs at SNR = 10 dB, where K = 3, 5, 10,100. 


Proof: We can rewrite (46) as 


C'sym < mill < log 1 + 


Kl 


(i) 


P 


(K — l)\g\ 2 P + 1 


+ log((/i - l)\g\ 2 P+ a 2 N2 ) 


K -2 

S lQ g 

k =2 
K -1 

^ log 

k =2 


(k\g\ 2 P + 


o 


N, 


fc+i 


V k\g\ 2 P + 


+ log 


\g\ 2 p+\g\ 2 

\9\ 2P + < K _^ 


log|^P 


/ 


. 2 \ ( ^-9)9*P+PN k ^N k ~o 2 N , I 2 \ 

1 -gfP + ol-- - k ■■ k ' 


~N k 


(K-k+l)\g\ 2 P+al 


V 


a 


Z k~ N k 


(55) 


/ 


where is the set of all (N 2 ,... ,N K _f) satisfying (47) and (48). 

Letting p 2 Nk = a 2 Nk = \g\ 2 for any k, we get af = \g\ 2 , which naturally satisfies (47) and (48) with 
equality. Then, the third and fourth terms inside the brace in ([55]) are canceled out. Substituting these 


values into (55), we get (54). 

The next result is a closed-form expression of Theorem [6] 

Proposition 2. A closed-form upper bound on the capacity of the K-user symmetric GIC is given by 


□ 


C'sym f log ( 1 T 


P 


{K — l)\g\ 2 P + 1 


+ log (i + {k — i)(i + \g\ 2 )P) 


K -1 


Ei°g i + i l_ ^i 2 ( l + M 2 ) p - 


(k-i)p+ 


i+lsl 2 


k =2 


kP + 


1+I9I 2 


(56) 
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Proof: Similar to (55), we can rewrite (50) as 


Csym < min 


log 1 + 


p 


{K — l)\g\ 2 P + 1 / 


+ log 


(K -l)\g\ip + a- 


n 2 


o 


Zi-Wi 


log 


log 


(K-l)\g\ 2 P + a- 


Wi 


{K-l)\g\*P + a^ 


^ 2 , f k\gP + o* Nh+1 

^ ° s ( %| 2 P + a 2 


P + Z k -Wk 


k='2 
2 \2 


(■ Pw K a w K ) \ 

{K-l)\g\*P+o*, K 


P-L\n\- 2 rr 2 (Pw K <r\v K fWjjff 

\ + l 9 ' Vnk., (K-l)\g\ 2 P+a 2 


- log kl 1 


iC -1 


/ 




k =2 


l-£| 2 P + a 2 


1(1—s)9*^’+PJV fc °'JV i , ~ a N k I 2 \ 
k~ N k (K-k+l)\g\ 2 P+<j 2 N 


V 


cr 


Z h -N k 


(57) 


7 


where /Csym is the set of all (Wi, Wk, N 2 ,..., iV^_i) satisfying (51), (52), and (53) 
Letting p 2 = a 2 = p 2 = a 2 = -. 


parameters of the upper bound in Theorem 6 , we can get 


< 1 for any k by exp 


oiting the symmetry of the noise 


o 


v. 


Wk 


~ - 


\g? 


i + M s 


2 2 
a Zk-Wk = °Z h -Nk 


TPW (58) 

which satisfy all conditions in (j5Tj), (52]), and ( f53) with equality. Then the third, fourth, and fifth terms 
inside the brace in (57) are removed. After straightforward manipulation, we have (56). □ 

Fig. [5] depicts the closed-from upper bounds given by the minimum of (54), (56), and ( [34 ) for different 
numbers of users at SNR = 20 dB. Notice that these closed-form upper bounds are rather loose relative 
to Theorems [5] and [ 6 ] since the closed forms are special cases of the latter bounds without optimizing the 
parameters, e.g., see Fig. [4; for the three-user case. The closed-form upper bound in (56) can be further 
tightened for large K in the following way. 

Proposition 3. For the cross-channel coefficient \g\ > 1 satisfying |g | 27 — |g | 2 — 1 > 0, where 7 > 1 is a 
positive real, a closed-form upper bound is given by 


C’sytn f log ( 1 T 


p 


+ log (l + (K — l)|g| 27 P) 


(K-l)\g\*P+l 

l-g\ 2 P (k-l)P+\g\~^ 


£ l0g ( 1+ 1- I^|- 2M 


kP + \g\~ 2ry 


(59) 


Proof: It suffices to let p 2 v = crj^ = l—\g\ 27 and p 2 N = o 2 N — \g\ 2 ^ 7 9 for any k. Then, we get 


a Zk-Wk - a V N) 

2 _ 1 

a Z k -N k ~ 1 


k - Nk 
= \n\~ 2 "1 


a 


Vw t 


= 1 


= |9| 

isr 2 *’- 11 

l »|- 22 


( 60 ) 


which transforms (51) into 


|9| 2 =l9| 2 -l>0 
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Fig. 6. 


Closed-form upper bounds on the symmetric rate of the A'-user symmetric GIC at medium and high SNRs, where K = 10 


5 


and satisfies (52) and (53) with equality. Notice that the above inequality holds true when \g\ > 1. Plugging 
into 


we obtain (59). 


□ 


Fig. [ 6 ] shows the upper bounds given by the minimum of (54), (59), and (34) for the symmetric positive 
real GIC with a very large number of users (K = 10 5 ) at medium and high SNRs, where 7 is numerically 
found and 7 = 200 was used. For g > 1, the upper bound in (59) is shown to be tighter than ( |56| ). This 
figure reveals that the sum-rate upper bound is still far from K/2 DoF near g 2 = 1 at realistic SNRs for 
the large number of user regime. For instance, the symmetric rates of our upper bound and TDM lower 
bound are 0.0186 and 0.001 bit, respectively, whereas that of the Kramer bound representing K/2 DoF 
is 0.8795 for g 2 = 0.9 and P = 5. 

Remark 6. The closed-form upper bounds were derived by exploiting an intrinsic structure 2 of the 


conditions in (47), (48), (51), (52), and (53) for the additional noise variables in our bounds. In fact, the 


structure was possible by removing the need for the optimization of the noise covariance matrix, i.e., iVj is 
only correlated with Z, in our upper bounds and so W* is. Our closed-form upper bounds in Figs. [5] and 
[fi] have no discontinuous point at g 2 — 1 for large I\ and practical SNR, where the closed-form bounds 
are a continuous function. The discontinuous point appears only in the high SNR limit and it ceases to 
happen at high SNR of practical interest (e.g., 20 dB). Combined with the small K cases in Figs. [4] and 
[9] this result suggests that the sum capacity of the symmetric real GIC might have no drastic change at 
least around g 2 = 1 at SNR = 10, 20 dB for any K. Therefore, this finite SNR analysis is not in line with 


the known DoF result in /281 that the DOF of K-user GlCs is everywhere discontinuous with respect to 
channel coefficients. 


2 This structure is represented by the fact that the proposed bounds are amenable to systematic canceling out some pairs of positive and 
negative differential entropies. 
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C. Large K Regime 

Based on Propositions [2] and |3} we will focus on the large number of users regime and conduct the 
large K analysis in this subsection. Inspired by the affine approximation of the capacity of code-division 
multiple access with random spreading introduced by Shamai and Verdu [331, we first consider the high- 
SNR approximation of the upper bound on the symmetric rate given by the upper bound in Proposition 
[2j For large K, the symmetric capacity C(K,P ) of Ji-user GICs can be approximated at high-SNR by 
the zero-order and first-order terms in the expansion of the capacity as an affine function of K and SNR 

(P) 

C(K, P ) = d K (K log P - K£ k ) + o(l) 

where d K denote the per-user DoF (first-order term) for large K defined by 

C(K, P ) 


d K — 


lim lim 


and 


rr-s-oc p->oo K log P 

i K is the power offset (zero-order term) in 3-dB units defined by 

C(K, P ) 


(61) 


= lim lim 

K —^oo P—yoo 


log P 


d K K 


Also o(l) —> 0 as K, P —> oo. Let denote the minimum of the upper bounds on the symmetric rates 
given by the upper bound in Propositions [2] and [3j Then we have the following result. 

Theorem 7. For large K and P, the symmetric-rate upper bound TZ“y, n is characterized as 

R£, = logP + 4 + 0 (l) 

where dp- = 1 and the power offset is given by 


(62) 


"K 


-log 

-log 


1-9| 2 (1+|9| 2 )) I«| 2 <1 

1 - 9 | 2 ) | 9 | 2 > 1 . 


(63) 


Proof: Taking the limit of P —» oo on the right-hand side of (56), we have 

k- 1 


K -1 


= log ((K - 1)(1 + |g| 2 )P) + 2 ^ log 

k =2 

7\— 1 


1*^(1+|^)P- 


k 


+ 0 ( 1 ) 


= log ((1 + \g\ 2 )P ) + 2^ log (|1 - g | 2 (1 + \g\ 2 )P) + 0(1) 

k =2 

= K log (|1 - ^| 2 (1 + |^| 2 )P) + O(logP). 


(64) 


Dividing the above equation by K and taking the limit of K —> oo, we get (62) for all values of \g\ 2 . 
Similarly, we do the same steps to the right-hand side of (59), which yields (62) for \g\ 2 > 1. Noticing 
that log (|1 — g| 2 (l + \g\ 2 )) > log (|1 — g\ 2 ), we obtain the desired result. □ 

For large K with positive real symmetric GICs, we can characterize the following three regimes of the 
ratio 7] = limfwoc 


V = 


SNR < t K 

+ K < SNR < 2t K 


(65) 


2 1 


K 


< SNR. 


While the first two regimes are suggested by Theorem 7, the third regime 77 = | is due to the Kramer 
bound. It is easy to see that at SNR = 2 t K 1, PT b m meets the DoF approximation given by 1 log(l+SNR) 


for the capacity approximation of the 1/2 DoF per user. 
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(a) g 2 = 1.1 




(b) g 2 = 0.7 (c) g 2 = 1.5 and I\ = 1000 

Fig. 7. Bounds on the symmetric rate of the positive real if-user GIC for different SNRs and K. In (a), the upper bound is given by the 
minimum of Propositions [2] and [3] In (b), it is given by Proposition [2] The red dash-dotted curves that represent simultaneous (non-unique) 
decoding or TDM lower bound are for I\ = 3, 5,10, 30,100,1000 from top to bottom. In (c), we compare two upper bounds in Propositions 
ID and [3] for K = 1000. 
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Fig. |7| shows how much the well-known 1/2 Do F (pe r user) result could be translated into a real 
potential 3 gain at finite SNR for different K. In Fig. 7(a), we can see the behavior of lower and upper 
bounds when K = 3 to 1000 and g 2 is close to 1, where l* K = 43 in dB scales. Fig. 7(b) shows that (65) 
is valid even when g 2 is not so close to 1. However, a close look at t K reveals that t K decreases as g 2 
tends to be far from unity. While the regime g = 0 is somewhat supported by the simultaneous decoding 
or TDM lower bound, the regime g = 1 might be fundamental if one finds a matching lower bound in this 
regime. Recall that our closed-form upper bound in Proposition |2] has been tightened in Proposition |3] 
Hence, it is shown in Fig. 7(c) that the regime g = 1 can be shifted to the right by 10 log 10 (l + \g\ 2 ) ~ 4 
dB, which validates 


An important implication of the above results is that for large K, the capacity gain promised by A/2 
DoF may not be achievable if SNR is no more than the power offset (or threshold) t K . In other words, 
the surprising performance benefit of sophisticated interference management schemes suggested by the 
DoF results in |241, [25j, |30 ] seems not realized at a realistic SNR (e.g., 10, 20 dB) over a certain range 
(around g 2 = 1) of channel coefficients for the (constant) Ji-user symmetric real case. Such a range of 
g 2 depends on the number of users and the SNR of interference networks. Namely, as SNR deceases 
and K grows, the range of g 2 gets wider according to the rule given by the SNR threshold t K in (63). 
Therefore, the well-known DoF result should be carefully interpreted at finite SNR from the perspective 
of our results. 


D. Asymmetric Case 

For the A-uscr asymmetric GIC, the upper bounds in Theorems [2] and [3] cannot be naturally generalized. 
We can naturally extend the genie variables in (|4) to the general A-user case as follow: 

Uk = ^ hkiXi + Wk 
i^k 

Sk = hk-i^Xi + Nk- ( 66 ) 

i^k—1 

Then, we present the following asymmetric version of Theorem |5j for the A'-user GIC. 

Theorem 8. The sum capacity of the K-user complex GIC in the mixed interference regime, where 
\hi t K)\ 2 < 1, is upper-bounded by 

K 

Y R k < Yig) + i(x KG - y kg IA^- 1 ) 

k =1 

K-l , 

+ Y l(x kG - S 2G Ixfe 1 ) + l{x hG - Y kG \X k 1G \XY)CC S 2 G ) [ (67) 

k=2 ^ ' 

for all N -2 satisfying a% 2 > h\ K, where Nk and Zk are independent (i.e., pN k = 0) for all k. Permuting 
the user indices, we obtain K\ bounds. 


Proof: See Appendix E. □ 

A major difficulty in the general asymmetric case with more than three users was that we cannot use 
the technique of (25) and |9l]) in the proofs of Theorems [2jand [5| based on Lemma [TJ As a result, the first 
mutual information inside the brace in ( [67]) serves as a penalty term for the asymmetric case, compared 
to the symmetric case in (46) of Theorem|5j Similar to the Theorem [ 8 } we can obtain the following result 
on the asymmetric complex GIC. 


^Notice that the solid curve in Fig. 7(a) comes from a simplified, closed-form (i.e., not the best bound we can get from our results) upper 
bound on the achievable rate of any sophisticated interference management scheme. 
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Theorem 9. The sum capacity of the Ii-user complex GIC is upper-bounded by 


K 

E 

fc=i 


1 


K 


k G'i Yk,KG \U k ,KG)+l{Uk ,KG ; Yk,KG + N k/2 ) 

k =1 


AT-l 

E 

1=2 


I ( X k/G ] S k) 2 G 


-yk,i— 1 

| A fe,lG 


+ /(x k/G'i Y k / G \ 


-\ rk : £ —1 \ rk.K 
■ A-u i n •) - A - ] 


k,lG 



for all {N k , W k : k = 1,..., K } satisfying 


a Vw kA - a h,2 - \ h k,i,k,K\ °z kiK -w K 


( 68 ) 


(69) 


where 

N k ,2 = 

Permuting the user indices, we obtain K\ bounds. 


_ 2 2 T\T 

a N k o a Zu K - W k , K ^ k ,2- 


Proof: See Appendix F. 


□ 


In this case, I(X k / G ] S k , 2 G\X k ' l f^) in (68) is a penalty term, compared to the symmetric case in (50) 
of Theorem [6j In the sequel, we provide a special case where we can avoid the penalty terms. 

If the channel coefficients satisfy 

7 ^13 , , hi 3 ll 1 3 

'Jl4 — 7 tl24, tl 15 — /125, ' ‘ ‘ , tl 1 K — 7 tl 2 K 

”■23 n-23 tl23 


we can rewrite (94) in Appendix |Ej using the same way in (25) for the three-user case as 

J(A7; y 2 re , s?\X?) < ME£ 2 W? + Jv?) - MEL W + N ?) 

+ nh(Y 2G \X 1G , S 2G ) - h( E£ 3 + Z 2 "| E£ 3 + A?) 

= MEL hliXp + Nf) - nh(Z 2 - h 23 h^N 2 ) 

+ nh{Y 2G \X 1G , S 2G ) - h(J2f= 3 huX? + Vf 2 ) 

where 


V N 


CAf(0, 


(7, 


.)■ 


(70) 


(71) 


7V fc v ^N k \ Z k -h k ^ k+1 h k l_ l k+1 N k ) 

Repeating the same procedure for all k = 2,... ,K and all permutations and doing the same things to 
( [97] ) in Appendix F, we arrive at the following result. 

Corollary 1. Given a permutation in terms of user ordering, when channel coefficients satisfy the condition 

(72) 


, _ hi- m+i , 

u i-i ,j h l 'j 


for i = 2,..., K — 2, j = i + 2,, K. the sum-rate upper bounds for the corresponding K-user 
asymmetric GIC are equivalent to the symmetric case in Theorems [5] and [6] 

V. Sum-Rate Behavior of “Asymmetric Complex” Gaussian Interference Channels 

So far, we have focused on the sum-rate analysis of the AT-user symmetric (positive) real GIC, where 
the phases of channel coefficients are not taken into account. Some practical implications of the existing 
DoF results have been revisited. In this section, we will investigate the sum-rate behavior of the A'-user 
asymmetric complex GIC at finite SNR, based on our upper bounds derived in the previous sections. Our 
study is motivated by the well-known toy example in [16] where the sum capacity is (j- log(l + 2 P) when 


the common direct- and cross-channel coefficients are 1 and V— 1, respectively. In sharp contrast, the sum 
capacity becomes just log(l +KP) when the channel coefficients are all 1. Hence it would be interesting 
to figure out what happens between the two extreme points. 
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Fig. 8. Bounds on the sum capacity of three-user symmetric GIC for different amplitudes \g\ 2 and phases (fr(g) of cross-channel coefficient 
g when P = 10 and 4>{g) = 0 : jg : 2n. The points labeled by ‘capacity’ are (j>{g) = respectively, with |gr| 2 = 1, which follows 

from the well-known toy example in G3- 


A. Symmetric Case 


Bearing the somewhat negative result in subsections IV-B and IV-C for the symmetric positive real case 
in mind, we first turn to the three-user symmetric complex GIC. We restrict our attention to \g\ 2 < 1 for 
ease of illustration. Although some existing upper bounds taken into account in this work are shown to be 
tighter than our upper bound in the very weak interference regime (e.g, \g\ 2 < 0.12 at SNR = 10 dB), we 
consider only the moderately weak interference regime (0.12 < \g \ 2 < 1), the main regime of practical 
interest, where the proposed upper bound is tightest. Therefore, it suffices to investigate the behavior of 
the new sum-rate upper bound. 

Fig. [8] shows the symmetric-rate behavior of the three-user symmetric complex GIC with the phase 
of the symmetric cross-channel coefficient g varying between 0 and 27 t. The four upper bounds derived 
in Section III have their own range of \g\ 2 , over which one is tighter than the other three, as the phase 
(j){g) varies. Our capacity upper bound result improves upon understanding the potential impact of phase 
difference between the direct-channel and the cross-channel coefficients on the three-user complex GIC. 
This sum-rate behavior could not be predicted by the DoF results. For example, the known result in |26 | 
for the three-user complex GIC shows that DoF is discontinuous at a subset of channel coefficients with 
measure zero. In particular, the result therein proved that the phase alignment scheme achieves only 1 DoF 
under certain amplitude and phase conditions, while it can achieve the same 1.2 DoF for almost all values 
of channel coefficients. Moreover, another result in [[161 shows that the three-user constant complex GIC 
has 1 DoF for g = 1 and 1.5 DoF for g = \/—1. This does not provide much insight on the prediction 
of sum-rate behavior at finite SNR for particular values of \g\ and oig). Hence we trace the trajectory of 
our upper bounds for different cj)(g ) with \g\ fixed. 

Fig. [9] depicts the sum-rate behavior of the four-user symmetric complex GIC at SNR = 10 dB by 
varying the phase 4>(g) such that </>(#) = 0, 7 t / 16 , it/8, 37 t / 16 , ..., n/2. We can see that the impact of 








27 



Fig. 9. Bounds on the sum capacity of four-user symmetric Gaussian interference channel for different amplitudes \g\ 2 and phases 

(j>{g) = 0,7r/8,7r/4, 37r/8,7r/2 (blue curves from bottom to top): P = 10. 


phase offset on the capacity upper bound is very analogous to the three-user case in (b) of Fig. [8} We 
also verified that this sum-rate upper bound behavior remains similar at least for the five-user symmetric 
GIC, but the corresponding figure is omitted for compactness of this work. 

In contrast to the symmetric real case, the capacity upper bound behavior for the complex GIC suggests 
that one may improve the lower bound on the capacity of the complex GIC. This might be done by existing 
sophisticated schemes exploiting the phase offset between direct-channel and cross-channel coefficients. 
However, we need to carefully interpret Figs. [8] and [9] where the phases of cross-channel coefficients are 
assumed to be already aligned , which is a very special case in realistic systems. 

Remark 7. For o{(j) = | or ff, the symmetric capacity (per dimension) is well known as \ log(l + 2 P) 
As seen from Figs. 8 am/[9] the proposed upper bound is tight for those values of 4>(g). This implies 
that our bound may be useful in the complex symmetric case. In fact, the Kramer upper bound is tight at 
those values of f(g). 


B. Semi-Symmetric Case 

Studying the Ji-user symmetric real/complex GIC only is obviously insufficient to predict the sum- 
capacity behavior since the probability that all interfering links have the same channel coefficient (or 
even the same phase of channel coefficients) is quickly vanishing as K increases. Meanwhile, the fully 
asymmetric case where all channel coefficients h t j can be arbitrarily different is too difficult to evaluate 
the resulting upper bounds and to provide an insight. To compromise between the symmetric and the fully 
asymmetric case, we introduce a K -user “semi-symmetric” GIC, where complex cross-channel coefficients 
for each user are different but all users experience the same SNR and interference situation, (e.g., the 
same INR defined by INR = ff'f j 1 y ; | J SNR). The JT-user semi-symmetric GIC can be formally written 












Semi-symmetric rate Semi-symmetric rate 
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Yk — Xk + giXk t i -)_i + Zk (73) 

2=1 

where P& = P for all k — 1,..., K. In particular, the three-user semi-symmetric GIC is given by 

Y\ = X 1 + 9l X 2 + g 2 X 3 + Z x 
Y 2 = X 2 + ryiX 3 + ^ 2 Xi + Z 2 

Y 3 = X 3 + (]\X\ + g 2 X 2 + Z 3 (74) 


where P fc = P for k = 1, 2, 3. 
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Fig. 11. Upper bound on the sum capacity of three-user semi-symmetric GIC for different phases when P = 10, \gi | 2 = 0.3, 

and \gn\ 2 = 0.7. 


Fig. [10 illustrates the new upper bound on the sum capacity of three-user semi-symmetric complex 
GIC for four different amplitudes (\gi\ 2 , |g 2 | 2 ) with phases (cf>(gi), varying between 0 and 2n, 

where \gi\ 2 = r/ 2 | 2 . For all cases, the time division lower bound is | log(l + 3 P) = 0.8257 (bit/channel 
use/user/dimension). In Fig. 11 we depicts the same upper bound for |< 7 i| 2 f g 2 \ 2 . In this case, our 


upper bound depends on the order of users and hence it was obtained by the minimum of (jj 12) and (14]) 
in Theorem |2j The upper bound behavior shows a large variation over the phase offset between o{g\) 
and </>(g 2 ). However, it should be pointed out that the behavior observed on an upper bound that is not 
matched by a lower bound may not be fundamental. Potentially, the upper bound behavior reveals some 
interesting results. In accordance with a consistent observation from Fig. 10, Fig. [TTJ, and other numerical 
results with different settings not shown here due to compactness of this paper, we have the following 
conjecture. 


Conjecture 1 . The sum capacity for the three-user semi-symmetric GIC may take its maximum values 
along the intersection of the following two types of lines 


20(<7i) — 0(g 2 ) + 7T = 0 mod 27 t 

20(g 2 ) — 4>{gf) + 7T = 0 mod 27 t (75) 

and it can be minimized along any of the following two types of lines 

2 <f>(gi) - <K# 2 ) = 0 mod 2vr 

2f(g 2 ) - (j>(gf) = 0 mod 2vr. (76) 


Notice that our conjecture does not necessarily imply that the points in the lines are always the extreme 
points of the upper bound, i.e., its extreme points are not always continuous as shown in Figs. 10 and 0 
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Remark 8. As a special case, the above conjecture includes some discontinuous singularities shown in 


some previous results (e.g., [26 Thm. 2 and 3]). For our semi-symmetric case, the conditions in Theorem 
3 of fflEj translate into 

M 2 = \f) 2 1 and 20 ( 0 !) - <j>{g 2 ) = 0 mod 2vr 
|0 2 | 2 = \gi\ and 20(fif 2 ) - 4>(gi) = 0 mod 2tt. 

If any of the above conditions is satisfied, the constant three-user complex G1C has only 1 DoF. 
Interestingly, the conditions (76) in our conjecture and the above conditions from [26 Thm. 3] have 
the common phase conditions. 

The semi-symmetric rate behavior provides an insight into the good (or bad) condition in terms of the 
phase offset between gi and g 2 for which a sophisticated scheme might (or could not in the bad condition) 
achieve a significant performance gain over the simple time division scheme. This is unpredictable by the 
existing DoF results. While the bad condition on our upper bound is supported to some extent by the TDM 
lower bound, the good condition should be verified by a matching lower bound. Furthermore, we can infer 
from the three-user semi-symmetric case that the capacity of the Ji-user complex GIC may significantly 
depend on the phase offsets of channel coefficients unlike the two-user case in |9), which shows that the 
phase offset between two cross-channel coefficients has a limited impact on the sum capacity. 

Although the semi-symmetric GIC is shown to be very relevant for the three-user case, its sum-rate 
upper bounds for K > 3 are given by Theorems [8] and [9] for the asymmetric case unless gi, g 2 , ..., g K ~ 1 
in (73) satisfy (72). Therefore, the value of the semi-symmetric GIC in (73) may be undermined due to 
the penalty terms in the asymmetric case that incur some loss of tightness of our bounds. 


VI. Conclusion 

We have developed upper bounds on the capacity of the A'-user complex GIC using a new type of 
genie-aided channels and a hybrid form of Etkin-type and change-of-interference bounding techniques. 
The resulting upper bounds were shown to be tighter than the existing bounds over a certain range of 
channel coefficients for the three-user case. We formulated closed-form expressions of the new upper 
bounds for the Ji-user symmetric GIC. Based on the analytical bounds, this paper has investigated K/2 
DoF achievable by interference alignment for almost all constant GICs at realistic SNR. In particular, we 
showed that for large K, the performance benefit promised by the K/2 DoF results may not be realized 
even at high SNR over a certain range around g 2 = 1 for the symmetric real case. As a consequence, it has 
been argued that the DoF results should be carefully interpreted at finite SNR. On the positive side, our 
result showed that the potential gain proposed by the existing DoF results may be realized at moderate 
SNR for the symmetric complex GIC, depending on the phase offset between the direct-channel and 
the cross-channel coefficients. We have further introduced the semi-symmetric GIC and evaluated sum- 
rate upper bounds for the three-user semi-symmetric case, yielding a conjecture with respect to certain 
conditions on good and bad phase offsets between cross-channel coefficients. 

We may leverage the conjecture with respect to potentially good and bad conditions, which suggests 
that an interference management scheme exploiting the phase offset conditions might be promising. For 
instance, one can perform phase rotation of multiple interference links to favorably align interfering signals 
according to the good phase condition (e.g., [26J). Alternatively, one may exploit the opportunistic nature 
of slow-fading wireless channels so that only user pairs whose channel coefficients are near the desirable 
phase condition are opportunistically scheduled to communicate with each other. Therefore, the good 
condition on phase offset with realistic values of SNR may deserve attention of a sophisticated scheme. 
On the contrary, we need to avoid trying to achieve an appreciable performance benefit while channel 
coefficients are near the bad condition. 

An interesting future study would be finding an interference management scheme that provides a 
matching lower bound to the good phase-offset condition of the upper bound in this work. The conditions 
on the phase offsets of channel coefficients can be generalized to more than three-user cases by using 
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the closed-form A'-user upper bounds. Yet another item would be to improve the proposed upper bounds 
based on a technique in the companion paper for two-user GICs in |9, Thm. 5]. 


Appendix A 
Proof of Theorem [I 


We first present a lemma to be used in various proofs in this work. The proof of the above lemma is 
skipped. 

Lemma 1. Let Yf = a,iX n + Zf, i = 1,2,..., m, where X n is a random sequence with the average 
power constraint such that = ] E | Xj\ < nP, and for all i, at is a complex number and Zf is i.i.d. 

), independent of X n . For i,k G [1 : m], the jth components of Z { and Z k are correlated each 
other with p^ = E[ZiZf\. Let S be the set of [1 : m — 1] and let Yg = (Yf, Yf ,..., Y£_f). Then we 
have 


h(Yg\Y£) = h(a m X n + V n ) + nh(W) - h{Y£) 


(77) 


where W = (Z$( i) — Z m ,..., Zs( m ~ i) — A an (m — 1 )-dim zero-mean Gaussian 

random vector whose i.i.d. sequence is denoted by W and V n is i.i.d. AT(0, Cov (Z m \W)). 


Using Fano’s inequality and [37, Lemma 1], we have 


<I{X?-Y?) 

{ <I{X?-Y?\XZ,U?) 

= h{Y?\X%, U?) - h(Yf\X i", Xf, Uf) 

= h(X r + zr - Wf\h 12 Xf + Wf) - h{h 12 X% + Z?\h 12 Xf + W?) 

= h{x ? + Z? - W?\h 12 X% + Wf) - h(h 12 X% + Vfo) 

+ h(h 12 Xf + Wf) - nh(Z 1 - Wf) (78) 


where (a) follows by definition of Ui and by the independence of the inputs, and ( b ) follows from Lemma 
[lj Similarly, we can get 


n^-e^KI^-Yf) 

<I(X^Yf\Xf) 

< nh(X 1G + h 12 X 2G + Zf) - h{h l2 X% + Z?). 


( 79 ) 
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Similar to (78) and (79), we have 


I(X r; Y?\X%) < nh(X lG + h 12 X 2G + Z x ) - h(h 12 X% + Z?) 

K, __ ✓ 

N/* 

= B 1 

/(AT; Y? |A 3 n , U?) < h(X ” + Z? - + W?) - h{h 12 X^ + V£} 

^-“ V "-'' v - v -- 

= A e *S 2 

+ h(h 12 X% + Wf) -n/i(Z! - Wi) 

'-7- 

= Ai 

/ W; *71^) < nh(X 2G + h 23 X 3G + Z 2 ) - /i(/r 23 A7 + Z 2 ") 

S -V- 

= b 3 

I{X 2 ; Z 2 n |AT, t/ 2 n ) < h{X 2 + ^ - W?\h 23 x% + W?) - /i(/i 23 X 3 " + 

'-----V'-■ ---- 

= A 2 4 b 4 

+ h(h 23 X™ + W, n ) -nh(Z 2 - w 2 ) 

" -v-—' 

= a 3 

I (A 3 ; r 3 n |A 2 n ) < nh(X 3G + h 3] X iG + Z 3 ) - h(h 3 x X* + Z?) 


= b 5 

i( AT; 171*2, &?) < H x 3 + z% - w?\h 31 x? + w?) - h(h 31 x? + v$ a ) 

""---' 0-V-- 

= A4 A Be 

+ h(h 3 l X? + iy 3 n ) -nh(Z 3 - W 3 ). 

" -V-' 

— a 5 


(80) 


Applying the worst additive noise lemma in [34] to A 1 and B\ in (80), and using the assumption of 
a'\ V] < 1, we can bound 


h(h 12 A 2 n + W?) - h(h 12 A 2 n + Z?) < nh(h 12 X 2G + Wj - nh(h 12 X 2G + Z 3 ). 

Noticing that h 23 A 3 + ILf and h\ 2 A 2 + are independent and applying Lemma ?? in Appendix A to 
A 2 and £? 2 , we can also bound 


Kx 2 + Z* - W%\h 23 Xz + W?) - h(h 12 X? + V£J < 

nh(X 2G + Z 2 — iy 2 |/r 23 A 3( 9 + W 2 ) — nh(X 2G + Z 2 — TL 2 + |(ii 2 | 2 VVi |/r 23 X 3 G + iy 2 ) 

— n log | /i i2 1 2 (81) 


for \h l2 \ 2 < 1 and cr^ 
rewritten as 


> \h 12 \ 2 a 2 Zn _ W2 . Then, the second term in the right hand side of (81) can be 


h(X 2G + Z 2 — W 2 + V Wl \h 23 X 3G + W 2 ) 

— h(X 2G + Z 2 — W 2 + VWJ/^S^G + W 2 ) — h(X 2G + (i 12 fVj + h(X 2G + /i 12 VVJ 

= h(X 2G + Z-2 — W 2 + | h 23 X 3G + (14) — h(X 2G + Z 2 — 1(4 + VwJ + h(X 2G + h {2 Vl-i/,) (82) 

= h(Y 2G + V Wl | Xia, U 2G ) — h(Y 2G + HvJ + h(X 2G + /i^ 1 VVJ 

= —I(U 2G ; Y 2G + V Wl \X 1G ) + h{X 2G + h^V w J (83) 


where we used the fact that the Gaussian random variables /i 12 14 


equivalent, and the condition in (6b) is intended to guarantee a 


Wi 
Vw x 


and Z 2 — H 4 + V Wl are statistically 
> 0. 
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Substituting 


into (81), we have 


— (A 2 — B 2 ) < h(X 2 G + Z 2 — W 2 1 h 23 X 3 Q + W 2 ) 
n 

— h(hi 2 X 2 c + Vuy) + I{U 2 g ; V 2 g + VWJ^ig). 


(84) 


In fact, I{U 2 g]Y 2G + V Wl \X 1G ) is a penalty term due to the conditional worst additive noise lemma. 
However, it can be seen from (82) that this penalty would be marginal in general. This is because 
assuming cr~^ = 0. 4 we have 


I(U 2G ; Y 2G \X 1G ) = h(X 2G + Z 2 - W 2 ) - h(X 2G + Z 2 - W 2 \h 23 X 3G + W 2 ) 

= (???)M* 2G + ^2 - W 2 ) - h(X 2G + Z 2 - W 2 \h 23 X 3G + W 2 , X 3G ) 
< h(X 2G + Z 2 - W 2 ) - h(X 2G + Z 2 \W 2 ) 

P2 


= log 


a z 2 -w 2 
-^2 + &% 2 \ w 2 


(85) 


Repeating the same techniques to the remaining A 3 through B e , we can upper-bound 2(R 1 + R- 2 + R 3 — 3e n ) 
as (|5|). 


We first bound R\ and R 3 as 


Appendix B 
Proof of Theorem|2] 


n(i?i-e n ) <I{X?-,Y?) 

< nh(Y 1G ) - h(y?\Xl) 
n(R 3 -e n )<I( X2;Y?\X?,X2) 

= h(X% + Z£) - nh{Z 3 ). 


( 86 ) 


(87) 


Combining (86) and (26) and using the worst additive noise lemma and the definition of < 1, we get 


h(S%) - h{Y?\X?) = h{h 12 X% + h l3 X% + N2) - h{h l2 X™ + h 13 X% + Z r; 
< nh(S 2G ) - nh(Y 1G \X 1G ). 


( 88 ) 


Combining (87) and (26), we similarly have 

h(X% + Z%) - h(h V3 X^ + V£) = h( A7 + 2%) - h( A- + h^VJ} a ) - n log | h 23 

< nh(X 3 G + Z 3 ) — nh{h\ 3 X 3 G + Vn 2 ) 

for Vn 2 satisfying > \h V3 2 , the first condition in (9), which also implies that \h 13 


(89) 


satisfied due to <jy < 1. Substituting (J88) and (89) into the sum of (86), (87), and (26), we get 


< 1 should be 


Ri + R 2 + Rs - 3e n < I(X 1G ; Y 1G ) + h(S 2G ) - h(Z 2 - h 23 h^N 2 ) + h(Y 2G \X 1G , S 2G ) 

- h(h 13 X 3G + V N2 ) + I(X 3G ', Y 3G \X ig , X 2G ). (90) 

We can then immediately translate ( [90] ) into (8j) by reversely using Lemma 1. 

As for the second condition in (9), it suffices to replace —h^nX^ + N^ — h^^X^ + Z^h^X^ + N^) 
in (24) with — h(h 23 Xg + Z%) — h(h\ 3 X^ + Ng\h 23 Xg + Z%) and to follow the same steps. This completes 
the proof. 


4 It will be later shown in Sec. III.D that this condition is used to tighten the bound in Theorem |l] 
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j(xr;yr>— •HX?;Y? i u r)\ ?j(A-r ; yr,s" i x*)«, r/(x?;yr,s" I A 3 n ,x 4 n )«, r I 


/(x 2 n ; y 2 >. +nx n 2 -,Y n 2 |t/”)r ^i(x”;Y^,s^ \ x 1 n )\ /hj(xj;y",sj 4 1 *;,*;*)«. | C/ 2 n ) 


/(* 3 ;y 3 >.«/(*”;y 3 1[/ 3 )r/ IX"), / i a?,*")-/ •/(*"; y;; 1 c/") 


J(X 4 ";y 4 "). + I ( X :; Y : \ U n A )i V(X? ; y?,S",| X ") • "*J(X 4 "; y ?, S 4 " 2 \ X ^ X^i \/(A-y^ 1t/ 4 ") 


‘ 4 ’ 4 1 4 


L 4’ 4’ 43 1 3 


4 ’ 4’ 42 ' 2 ’ 3 


'4 ’ 4 4 


Fig. 12. Graphical representation of the relation among mutual informations for the four-user case, where the solid lines corresponds to 
one of the four components in {50[ > for I\ = 4 and the last column is redundant and just given for illustrative convenience. This shows how 
positive and negative entropies should be paired with each other in <[93|> to derive a useful upper bound. 


Appendix C 
Proof of Theorem E 1 


We begin with 


IW; V") < nh(Y ia ) - h(g ZZ 2 A? + Z?) 


= HlB 


/(AT; V 2 n , SJIAT) < h(g Zf. 2 A” + V?) - h(g £f =3 A” + V?) 

+ nh(Y 2G \X ia , S 2G ) - h(g ZZs A” + Z 2 \g ZZs A,” + A?) 
= h(g Z!L 2 A? + JVJ) —nh(Z 2 - N 2 ) 


— PlA 


+ nh(Y 2G \X 1G , S 2G ) - h(g £,= 3 Af + V&) 

'-v- 

— PiB 
\K 


/(A7; Y 3 n , SS\X?, X?) < h(g Els A? + N ?) -nh(Z 3 - N 3 ) 


= P2A 


+ nh(Y 3G \X 1G , X 2G , S 3G ) - h{g EIa X ? + V D 


(91) 


I( x l-Y Yk- i, • • •, A£_ 2 ) < h(g EIk .i Af + 7V£_i) - - 7V*-i) 

+ ^^(A(k-i)gI-Aig, • • •, X( K _ 2 ) G , S(k- i)g) — h(gXx + V^ K _ 1 ) 


— 03B 


I(Xk; Yk\X[\ • • •, A- _,) = /iffi + Zl) —nh(Z K ). 


(92) 


= /? 3 A 


Notice that the cross-channel coefficient g in should be canceled out as shown in (49). Applying the 
worst additive noise lemma to /3ia — 8 ]b, 82 a — P 2 b for the condition in (47), and 8 3A — /3 3B for (48), 
respectively, we get (46). 
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Appendix D 
Proof of Theorem® 


By symmetry, we can write 


/(AT; AT) < nh(Y\o) - h(g Ef. 2 A” + Zf) 


-V- 

A 

— 7lB 


/(A?; y 2 “, SJ| A”) < % E,= 2 A” + A?) ~nh(Z 2 - JV 2 ) 


-V- 

A 

— 72 A 


+ nft(A 2C |A IO , S 2G ) - h(g £'i 3 A” + VJfJ 


MAJ; i?, SjTA,”, A“) < h(g Z'i 3 A” + A?) -»fc(Z 3 -TVS 


= 73A 


+ n/i(Y 3G |X 1G , X 2G , S 3G ) - h( g EL *T + V&) 


I W-r;y?-i,sj-iW. ■ ■ ■,ai_ 2 ) < %Ef=x-1 *r + ^-i,r) - ^(^-1 - ^-0 

+ nh(Y( K _ i) G |X 1G ,..., X(k~2)g, S k ~i)g) ~ h(gX% + V^ K i ) 


-V- 

A 

— 74 B 


/(X-; Y£\U%) = h(Xl + ZI- WZ\U n K ) - h(g E^ 1 X” + 


= 74A 

^ir-i 


= 72 s 


+ % Ef=i A? + W7) -n/^Z* - W K ). 


(93) 


-v- 

A 

- 7lA 


Noticing that h(g Zf=i ' X" + l/ v "/ /f ) and h(g Z?= 1 ' Xf+W£) are statistically equivalent to h(g Zt=2 Xf+ 
V7,) and h(gY^f=2 X” + IX”), respectively, by symmetry and applying the worst additive noise lemma 
to 7 ia — 7ib for the condition in (| 5 T) and to 72.4 — 72 b and 7321 — 735 for (j 52 j), respectively, and applying 
the conditional worst additive noise lemma to 74,4 — 74 B for ([ 53 ]), we get ( 50 ). 


yK -1 


yK 


Appendix E 
Proof of Theorem® 

Here, we cannot use the technique in (25j) and ([91). Therefore, rather assuming N k and Z k are 
independent, for 3 < k < K — 1, we can get the following upper bound: 

T( yn . yn Qni yn yn \ 

1 x k- 1? °2 I^M 5 * * * i^k-2) 

t( yn . nn \ yn yn \ . t( yn . yn 1 yn yn rrn\ 

~ 1 1? *^2 I A 1 j * * * ? 2 ) + -* V A /c-l> *fc-ll A l ? • • • j A /c-2> *^2 J 

(a) 

^ T( V n . C n l yn \ 1 t( yn . yn 1 -yn yn yn yn rm\ 

7 *^2 I A 1 j * * * > A /c-2J + 1 1? r fc-ll A l j * * * > 2? A /c j * • • 5 A 10 *^2 J 

= ME.X, M,A|> + a?) - MTJU A«-X? + A?) 

+ MAT-i + zMIMjmA^ + A") - MZ?-,) 

< MEL_, MiA” + AJ) - MEL MiA? + JV?) 

+ nh(X(k- i)g + ^fe —1 iX(fe_i) G + X 2 ) — nh(Zk-i) (94) 

r/yn. yn nnl yn yn \ 

7 1 Y k 1 ^2 I A 1 > * * * > A /c-lJ 


< MEf=* fciiA,” + A?) - MEf= l+ i ftiiA,” + a 2 ”) 
+ nh(X k G + Z k \hikXkG + X 2 ) — nh(Z k ) 


( 95 ) 
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where (a) follows from the independence assumption between X”, ..., X%_ 2 , X %,..., X' n K and S 2 , and 
in ( b ) we used the assumption that X]';, and NJ? are mutually independent for all k. We can see that 
the second term in ( |94| ) and the first term in ([95) are canceled out. As before, using the worst additive 
noise lemma, we get (67). 


Appendix F 
Proof of Theorem [9 

We rewrite some mutual information terms that are different from the symmetric case in Appendix jDj 
as follow: 


U AT; W) = A(A? + z-; - ivric/D - HXL i^x? + vs,) 


— 

= S 1B 


+ MEL hii*i + WT) - nh^z, - WO 


J(X- IT, 5 2 "|xr) < ME£ 2 hu AT + JV?) - MEf=3 W 

"- v -' "-V-' 

= S 1A ± 5 2B 

+ nh(X 2 G + Z ‘2 1 h\ 2 X 2 c + X 2 ) — nh(Z 2 ) (96) 

W;El at, x%) < h{Y!Lhi*? + n 2) -MEL h u x? + n?) 

' -V- / 

— <5 2 a 

+ nh(X 3 c + Z^\hi 3 X 3 G + N 2 ) — nh(Z 3 ) 

I{Xk-\i Yk- 1, EIE\ • • •, XI _ 2 ) < ME ? =a-i W + JV?) - MEx-at + N2\ 

V -V- ' 

— 53 s 

+ nh(X(K-i)G + Zx—i | ^i,if-iA(x-i)(j + X 2 ) — nh(Z K _i) 

I{Xl ; Y?|E/£) = + Z” - W£|E/£) -ME*! 1 + v^) 


A 


-S'- 

= <5 3 a 
■»A—1 


(97) 


+ MEf=7 ^A^f + W£) - n/i(Z^ - WT) 

where (96) comes from (94). We can then apply the worst additive noise lemma to 8\a — 5\b for a v Wl — 
cr^ 2 , apply the conditional worst additive noise lemma to S 3 a — Mb for a% 2 7 19 9 

Ma — $2 b = 0. Rewriting 8 3 a — 5 3 b in a similar fashion to (31), we can get (68). 
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